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mcnt III t'iiu arL'a of i-ulural iona 1. Locfniolu^^v that ap; it-a to nMlitary iraininy. 
("If LnLorcsL are nii^tluuls fur training individualrs to develop and ullIu^o inMLruc 
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nel from tiie I)i rcccorates of I'raLnlnj^ Development at Ft. Ike.oir, VA antl Ft. 
Ciordon, (;a provLded aHHiHtance in the evaluation of the work. 
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JOB AID MANUALS FUR PHASE ri-DI^SIGN OF Tlli^ I NSTRUCTTdNAL HYHTFMS iWVVinPMVxT 
MODEL " "" ' ^ " 



To devciop a Horius of Juh aJdH fur the actlviCLOri identine.i in tlu 
Inscructiona] Systums Devulopmont; 



Model (IHU, TIUDOC Pamphlet 150=30) 



ProcedurL' ; 

A series or Job aids were designed and developed for eaoh of the fiw 
pnasoH of the rSI) model: ANALY?^n, nESlGr:. DEVI-LOP, IMPLE:ii:XT, and CU:^TRuL 
Each joD aid is comprised of Descriptive Authoring Flowcharts nnd a Job A ^ i 
-lanuai wnich provide specific guidance, examples, and references necessary t< 
produce the product specified bv the ISD Block it rovers " ^ 



Utilization: 



These job aids will be used by militarv trainlnc pereonnol 
requiremencs of the IHD model. 



nee tine tfiq 
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Job Aid for Developing Ubjuctiva^; 

TSD 11.1......., = ,... _ _ . _ , 
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TSl) T r . 2 F= 1 

Job Aid fur UoHcribing Entry Bijinvioi; 

TSD I U 3. ............ . ^ ^ ' - - • ^^^^ 

Job Aid for DoterminG Sequence and Striicture 

rSD [T.4. ................... . ...... H-1 
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Job Aids? ' , , . ^ . . ^ ^ ............ 1 
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Job Aids? ; 5 
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What Instruction is Provided Within the Flowchart Symbols? 9 
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What is the Flowchart Block and Page Numbering System? , = , , , 10 

How Do I Use the Job Aid Manual and What are the Main Parts of it? , 11 
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of Worksheets? ... 12 
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FIELD SU RVEYS 
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When Should Formal Pield Surveys be Used? 

How is a Field Survgy Questionnaire Desfgnea? 
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Hov^^ is a Survey Sample Selected? 
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PANELS 



VVhat IS a Panel of Experts? 

When is a Panel Used? \ . _ . . 

When are Subject Matter Experts Used? 

When are Recent Job incumbents and/or Supervisors Used? 

How is a Panel Assembled? 



APPENDICES 

A Example of a Closed Form Questionnaire 
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1 Five Phases of Instructronal Systems Development 

2 ISD Blocks in Each of the Five ISO Phases 

3 Outcomes of ISD Blocks . . _ . . 
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iCr/AT AkE JOS AIVS? 



Aid? intended ic ^:ii-d-:iio:u-, ^tep-by prcc^^u^^ cuiuL?^ ^s■-;o:^ 
wo no^^* %vil! permit you :o rum out quality insrrucnonaJ produce quicklv 
and easily. \Vt? also hope :hai they will be equally useful :o individual? .it" all 
^^vpr'nenc^ levels of the instrut'iional sysLems developmen: process, 

- oob Aid^ dxtj intended to addreh& real needs. Pnur to the development of the 
Job Aids, mstnictional technology personnel (individualj like yourself) at the 
U.S. Army Signal Center and the U.S, Amiy Enpmeer School were surveyed to 
determme specific ISD needs— those areas in which they had the £rre;Uest need for 
assistance and information. Emphasis waJ placed on satisfyin?i these needs m the 
rievelopment of the Job Aids. 

^ Job Aids use the same classification system for identifying the activities that 
must he perfornied m instructionaj systems development fISDi as does 
rRADOC Piimphlei 350^30 i Interser/ice Procedures for Instructional Systems 
Development). 



WHAT IS THE ■CLASSlfJCATWN SySTBM USED W TRAVOC 
PAMPHtET 350-30 ANV JOB AWS? 



^ TRADuC Pamphlet 350^30 suggests that instructional systems developm^'nt be coi 
ducted in five phases: 

" Analyze 

" Desipi 

~ Develop 

^ Iinpiement 

" Control 

® For those of you who are unfamiliar with TRADOC Pamphlet ^nO-rw we surrgesr ' 
you read the bn^descnption of each phase of the ISD process as showm in ' ' 
Table 1. In the TOADOC Pamphlet each ISD phase is aivided into specific 
activities called ISD blocks. Tabie 2 shows these ISO blocks and Table 3 shows,.... 
the outcome of each block, 

^ Job Aids cover the activities required for the first three phases of the 

TRADOC Pamphlet (i.e., Analyze, Design, and Develop instructional systems). 
The Aids cover each ISD block withm these phases except for ISD Blocfc LI, 
Analyze Job. , . ' 



Inputs, proses, ana oulpuu in Phase I are all based on |0b mformalion. An mveninrv of job 
QUAC^'^ I ' cc^^i'^ -^5 G.y:Siv€ into fv^o grouys: I^iK^ fict ^sleciid fsf instryction and ta^k^ 

^ iiMO^ . s^tectea fOf mitryction. Performance nandards tor usks j^gk^cted for .nstruct.On are dei^rrnmeri 
4N V7F ^"t^'^'-^ observatien at job utes and y^nfied by -jb-sci m^ner experts. The inalysis of 
v^.. .,_^L^ ejc.snng cOur.e doeumentotign don. to detgrmm^ If : or portions sf the an^ly^.s ph^s^ and 
other phai^i have alre^y b^n done by lomeoris elsf fcHowing the (SD guidelmei. As a final 
anityiii phjs€ s^gp, the Hit of tasks leltcted for instruc: an is inilvzed for tfis most smtable 
insiructiQnal titling far egch tpk. 



Beg.nning w,th Ph^nn ir thn fSD modei is concerned w.th dOLtgniRg .nstryct.on y.ing the job 
PHASE !i S^aiysfS inforrrsation fforn Phis^ i The first Hep 15 The convefsion of each tisk selected far 

D^^i/^Ki ^''^'^'^S, ^''^ - tsr^ina! Igarning Qbjectiwe. Each terminai learning ob|ecti¥e 11 ther* aiiaiyzed to 
tOlt^r^ determ.nMearnmg oDiectives and iearnmg stepi nfce^Sifv far ma^fery 01 the terminal learning 
Objective. Teni ire designed to match the learning objecHvf s. A sample of stydents iS tested to 
.niure that fhe.r entr, behav,ori match the Jevel of learnmg inalys.s/ Finally , a s^Quarice of 
initruciiOn IS designed for the learriing Qbjectives. 



The instructional deveiopment phiie beqmi with the ciDlsif icat;on of le^mmq objective? by 
learriing dategory so a-^ to identify learning guideline-, ner.e ^ry for opt.mym leammg w t^ke 
PHASE l!f Determining how instruction is to be packiged ..id presenred to the student .1 

, accomplished through a media selection pro^ss whic-h takei mto account such factors as 

r :ZLUIr category and guideline, media Characteristics, training setting critena, and costs. 

Initrucnonal rt^anafiement plans are deveioped to allQCate and manage all resources for 
conducting innruction InsTructiOnil maienals are selected or developed ar>d tried out When 
matenals have been vahdated on the basi^ of empirical data obfatned from groups of typical 
stud<ints. the course iS ready for imDJementttion, 



PMA^"*^ l\/ training is required for the implementation of the insiructPOnal managiment plan and the 

PrlZ-vC^r^ iV instruction, Somp key perionn^l must b?? rrair^d to bf risn.^neri m the sp^^cified man.Tgcrnent 
plan. The instructional Staff must be trained to conduct the instruction and coliect evaluative 
-data on all of the initructionni '^^^mponents. At the cbfnpletion of each instructional cycle 
man^ement staff should be ab ise the collected information to improve the instructional 

systeni. 



'LEyENT 



Evaluation and revision of insffuctjon are earned out by p^fsonnel who preferably are neithtr 
PHAQP M instrwciionai designers nor the managers of thf couri^ urxjer study. Thf first activity 

(intfrnal evaluation) is the anaiysii of leirner performance m tne course to determine instances 
CONTR^JL deficient or irrelevant instruction. The evaluation taim then sugtesis solutions for tht 
W problBms. In the txternal fvaluatiorr; personnel assess job task perforfTlinCi on the job to 
determine the actyai performince cf course graduatet and other job fncumbents= AM collected 
data, internal and fx^mal, cin be uitd ai quality control on^innruetkan and as input to any 
phase of the lystem for revision. 



WHAT ARB SOME SOURCES OF M SIGWIFICAWT PATAf 

There are many sourcts of data to support a job aiialysis/ 
These sources include such things as: 
. / • Tech: .cal Manuals \ 

• Field Man^s . j " 

• Army Regulations 

• Circulars and Phamplets \ 

• Proems of Instruction \ 
■ • ® Soldier^s Manuals 

• Previous Tmk Lists \ ^ 

• DocUmentatiDn from the Systems Engincfering Era 

• Reporti from outside agencies, i.e., ^my Research Institute, HuniRRO, 
and other miUtaiy and civilian research organizations 

e Intemal Research Reports \ _ 

• Tables of Organization and Equipment'and Tables of Distribution and 
Allowances 

• Civilian Publications (technical joiunals and'professionaj publications) 

• Equipment Modification Work Orders 
^ ^ CODAP (Cornprthensive Occupational Data Analysis rtopams) 

• Field Survey^^ , 

• Panels of Experts \ ^ ... 



WHICH SOmCES OF VATA ARE IhlCLUVBV W THB RESOURCE 
MANUAL? 1 

Each of the sources listed is useful for fulfiUini specWic needs in the Analysis Phase 
of ISD. The Job Analysis Pkn should specify exactly which items of data will be needed 
and^the recommended source(s) for each item. In this way aU the data can be accessed and 
ready for use as soon as it is needed. The last three sourck on the list CODAP Field 
Surveys, and Consensus Groups or Panels, are frequently cited in the Job Aids for 
specific Items of infonnation. How to use these sources is khe subject of this manual 



Table 2 

ISD BLOCKS IN EACH OF THE FIVE ISD PHASES 



m lAOH PHASE ARl: 



PHASE i 



PHASE II — 



1,1 

ANALYZi 
JOB 



DEVELOP 
OBJiCTIVES 



PHASE 11! 



PHASE IV 



PHASE V 



mi 

SPtClFV 
LEARNING 
f VENTS/ "~ 
ACTlViTlES 



1.2 

SELfCT 
TASKS/ 
FUNCTIONS 



1 .3 

CONSTRUCT 
JOS 

PERFORMANCE 
MiASURiS 



1.4 

ANALYZi 
fXiSTiNG 
COURSES 



1.5 

SiLECT 
INSTRUCTIONAL 
SETTING 



2.2 

DEVELOP 
TESTS 



n3\ 

^DESCRIBE 
iNTRY 
BEHAVIOR 



DETtftMINl 
SiOUENCE Bi 
STRUCTURE 



m.2 

SPECIFY 
INSTRUCTION 
* MANAGIMENT 
PLAN Sf 
DELIVERY 
SYSTEM 



IMPLEMINT 
INSTRUCTIONAL 
MANAGEMENT 
PLAN 



m 2 

* CONDUCT 
iNSTRUGTiON 



^.1 

CONDUCT 
INTERNAL 
EVALUATION 



^.2 

CONDUCT 

EXTERNAL 

EVALUATION 



m.3 

REVlEW/SlUiCT 

EXISTING 

MATERIALS 



» DiVELOP 
iNSTBUCTiON 



m 5 

^VALIDATE 
INSTRUGTION 



2 3 

REVISE 

SYSTEM 
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OUTCOMES OF ISD BLOCKS 



1 OUTCOMIS OF THl BLOCKS ARl t 

= , a list of ta^s performed in a particular job. 
. a list of taski selected for trainii^, 
. . a job performance measure for each task selected for instruction. 
. . an analysis of the job analysis, task selection, and performance measure 
conitruction for any exmmg instfuction to determine if the^ courses are 
usable in whole or in part 

. . selection of the initructional iftting for task lelegted for instruction. 



. a learning objective for and a learning analysis of each task selected for 
initructjon. 

. test itemi to measure each leammg objective. 

. a test of entry behaviors to see if the original assumptions were correct. 
. the sequencing of all dependent tasks. 

. the dassificaiion of learning objectives by learning category and the 
identifieation of appropriate learning gyidilines. 

. the media selections for instru^ctional 'development and the Initructlonal 
management plan for conducting the instruction. 

. the analysis of packages of any existing instruction that meets the given 
learning objectives. 

. the development of instruction for all learning objectives where existing 
materials are not aviilable. - i 

field tested and revised instructional materially 



documents containing information on time, space, STudtnt and instructional 
resoufces, and staff trained to conduct the instruction. 

a completid cycle of instruction with information needed to improve it for 
the succeeding cycle. 



data on instructional effectiveness. 

data on job performanci in the field. 

instfuctiOna! svsiem revised on basis of empirical data. 




WHAT SOtmCES OF INWRMAnON WEm USEV IN THE 
VE\/ELO?mhIT 0¥ JOB AWS? 



• Job Aids are not just a re^hash of TRADOC Pamphlet 350-30. We use the 
saine clajsification system for ISD phases and the blocks within the phases 
as does the TRADOC Pamphlet. However, the guidance and information provided 
in the Job Aids come from a vmety of sources, the TRADOC Pamphlet being 
only one such source. We have gathered information from any source that we 
could locate. If the information was judged to be good it was included in the 
Job Aids. In some instances the Information in the Job Aid is based soleiy on the 
educatiortal technolo^ axperience of the project staff. 

® It is not within the scope of this Introduction to list all sources of information 
examined or us^ in the development of the Job Aids. However, in addition 
to TRADOC Pamphlet 350*30 examples of other sources of information would 
include the following types: 

— TRADOC Circulars 

— DA Pamphlets 

— Printed Guidance prepared by TRADOC Schools (e.g., U,S. Army 



Signal Center) 



^ Army Research Institute Documents 

^ HumRRO publications 

^ Other military' and civilian agencies 



S 




WHAT m AWS ARB mESEhJTLV At/AILABLE ANV WHAT VO 
' THEY CONSIST OF? 

^ There aie thirteen Job Aids presently avidlable. Each Job Aid is comprised 
of documents. A brief description of each is provided below: ( A 
complete description of how to use each is given on the pages that follow.) 

- D^criptive Authoring Flowcham The Descriptive Authoring Flowcharts (usually 
referred to as Flowchart Manuals) are the primary documents used in the 
Job Aids. They direct the user to ipecific guidance, examples and references 
provided in the Job Aid Manuals, 

Job Aid Manuals. As steted above, the Job Aid Manuals provide the specific 
guidance, examples and references necessa^ to produce the product specified 
by the ISD Block they cover. ' In addition, each Job Aid Manual contains one 
or more Worksheets to use in the development of the product, 

• Another important part of the Job Aids package is of course the document 
you are presently reading, Introduction to the Use of Job Aids and Job 
Aid Resource Manual. 

• The specific Job Aids available are: (Flowchiat Manual and Job Aids Manual 
for each), 

^ Job Aid for Selecting Tasks for Training (ISD L2) 

— Job Aid for Conducting Tajk Analysis (ISD L3) 
^ Job Aid for Anal^iiing Existing Courses (ISD L4) 

Job Aid f or Selecting Instaictiorial Set^^ 

^ Job Aid for Developing Objectives (ISD ILl) 
Job Aid for Developing Testa (ISD IL2) 

— Job Aid for Describing Entry Behavior (ISD IL3) 

^ Job Aid for Determining Sequence md Structure (ISD IL4) 

Job Aid for Specifying Learning Events and Activities (ISD IILl) 

^ Job Aid for Specifying Instructional Management Plan and Deliven^ 
System (ISD III.2) 

— Job Aid for Review md Selection of Existing Materials (ISD III.3) 

— Job Aid for Developing Instruction (ISD IIL4) 

^ Job Aid for Validating Instruction (ISD IIL5) ' \ 
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WHAT ARE THE MAIW PARTS OF THE FIOWCHART MANUAL? 

• Scan through a few pages of your Flowchart Majiual. Observe the following: 
— Flowchart symbols used 

^ Instructions or questions within the flowchart symbols 

^ Supplemental information opposite most of the flowchart symbols 

^ Flowcnart block and page numbering system 

® For a complete description of each of the main parts of the Flowchart Msnual 
see the pages that follow. ' 



WHAT FLOmAZr SmBOLS ARE USEV W THE FLOWCHART HANUAU 



• Fipwchart Symbols 



Only five symbols axt used in the Flowchart Manual, These symbols and the 
instructions withm them act as a road map to lead you step-bv^tep through 
the process of developing your particular product. We believe' that after vou 
have fotten used to using the Flowchart Manual you will find it a very um^uI 
control aocument. The five symbols used aie as follows: 



GZ) 



Start'Stop ''symbol — Indicates either the start or stop 
of the activities caJl^ for in the 
. Flowchart Manual. 




DeGision Symbol 



Indicates that ycu must make a 
decision at this point which will 
determine the path that you take 
thru Che Flowchart Manual. 




Manual Symbol - Indicates that you are to refer tb 
the Job Aid Manual for specific 
additional guidance or- Instruction 
shown in the symbol. l 




RtcGngle Symbol - Indicates an activity that must be 
- perfor-med-but d©ee-r^Hrequire-~ 
specific additional fuidmce or 
instruction in the Job Aid Manual. 
(In some cases the user is given 
the option of goinf to the Job 
Aid Manual to see a completed 
example of the activity called for 
in the rectangle symbol). 



C3o To Symbol - Indicates a branch to some other 
flowchart block. The branch will 
either be to a previously encountered 
block or will jump you over blocks 
' that can be omitted. 



18 



mAT iNsrmcTWN is pro\/wev o/tthiw rwE flowchart 
svmoLs? 



Each flowchart symbol except the Decision Symbol contains a brief statement 
of the'activity that you are to perform. If this activity requires the completion 
of part of a Worksheet the specific part of the Worksheet will be identified 
(remember, each Job Aid includes one or more Worksheets). Decision blocks 
.always contain a question that can be answered with a yes or no answ^er. The 
branch you take after the decision block wfij depend upon your answer. 
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mAT IS THE PmOSE OF THE SUPPLEmm-AL THPOmATlOH 
PROnVEV W THE FLOOJCHART mUAL? 

• The supplemental inforraation that is located beside most of the flowchart symbols 
&erves the following purposes', 

- Provides a more complete description of the steps or activities that must be 
performed in the ISD Block you are working in than does the flowchart itself. 

- Refers you to specific pages within the Job Aid Manual for specific guidance, 
examples and references needed for completing the activity calied for in the ' 

' flowchart block. (This is associated with the Manual symbol.) 

- For some nowchart blocks (rectangle symbol) examples of the compieted activity 
are shown m the Job Aid Manual. The supplemental information indicates the 
specific paie m the Job Aid Manual containing the example. However the user 
has the option of going to the Job Aid Manual to see the example. (The Manual 
symbol, on the other hand, requires the user to go to the Job Aid Manual.) 

- Acts as an executive summary which will allow commanders and supervisors to 
obtain a picture of the activities required by the Job Aid without reading the 
entire Job Aid Manual. 



WHAT IS THE FLOWCHART BLOCK AND PAGE mmERJNG SVSTEfJi? 

• The flowchart block and page numbering system is as follows: 



Tlowchait blocks are numbered so that they can be easily referred to. 

— The page numbers in each of the 13 Flowchart Manuals are preceded by an 
identifying letter unique to a specific ISD Block. (E.g., The Flowchart Manual 
pages for ISD Block 1.2 go from A-1 to A-15 whereas for ISD Block 13 the 
Flowchart Manual pafes go from B-l to B-IS.) This same page numbering system 
IS also Msed in the Job Aid Manuals. ' 
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HOW VO I USE THE JOS AW MANUAL AhlV WHAT ARE THE 
mhl PARTS OF IT? 



9- It is unUkeiy that you will need to refer to every p^ge in the Job Aid Majiual, 
As previDusly stated, the Job Aid Manuals are used as supplvaments to the Flow- 
chart Manimls that direct you to specific pages within the Job Aid Manuals. 
Therefore. DO NOT ATTEMPT TO USE THE JOB AID MANUALS INDEPENDENTLY 
OF THE FLOWCHART MANUALS, 

• Scan through a few pages of your Job Aid Manual, Obsen/e the following: 

^ Partial flowcharts shown at the top of pages 

^ Questions written in script that appear on most pages 

Completed, or partially completed examples of Worksheets 



WAT IS THE PURPOSE OP THE PARTIAL PLOWCHARTS AT THE 
TOP OP SOME PAGES OP THE JOB AW MANUAL? 



• When you are refeinred to the Job Aid Manual you will find a partial flowchart at 

* the top of the Job Aid Manual page. You are to remaia working with the Job 
Aid Manual until you come to Another partial flowchart. Then return to the 
Flowchirt Manual, 

# The partial flowcharts EU-e identical to those shown in the Flowchart Manual. 

^T*h¥y'Wm"as~an' additio 




moment. 



"X 
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mr IS WE ?m?osE of the qu^tions miTTEN w script 

THAT APPEAR OhI SOME PAGES OF THE JOB AW mUAL? / ' 

• The questions written in script are our way of telling you what follows They 
highlight such things as; ' ' 

— The purpose of performing a certain activity 

— How the activity is perfornied 

- What sources are available for performing the activity and how good they are 

- What the Worksheet looks like after the activity is performed 

WHAT 15 THE PURPOSE OF THE COMPLETEV OR PARTULLV 
COMPLETEV EXAMPLES OF OJORKSHEETS? 

• As previousJy stated, every Job 4id Manual uses one or more Worksheets 
(located m a pocket at the back of the Manual). The Worksheets permit you to 
produce Land document) the product called for in the ISD Block. 

• Whenever you are required to make an entry on a Worksheet an example of that 
type of entry will be shown in the Job Aid Manual and wiU usually be circled so 
as to make it stand out. It is hoped that these examples w-ill give you a clear idea 
of what IS required on the Worksheet. 
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WHAT VOBS THIS ALL MEAW AWP O/HAT VO I PC NOW? 

• In this Intr^uction we have attempted to explain the following: 
•^What Job Aids are 

The deification system (ISD Phases and Blocks) used in the Job Aids 
Sources of information used in the development of Job Aids 
Job Aids preiently available 

^ A description of Flowchart Manuals 

^ A description of Job Aid Manuals 

• If you feel that you have an adequate understending of the above, return to the 
giowchart Manual naw . You will be referred to specific pages in the Resource 
Manual (the remainder of this document) as you ne^ the infonnation contained 
in them. Do not attempt to read the Resource Manual now. 

RETURN TO THE FLOWCHART MANUAL NOW 
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JO^ AIDS RESOURCE MANUAL 
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HOW CAW THE RESOURCE MAWUAL HELP ME? 

The purpose of ^this resoiircff majiual is to assist you in the fonnation of a data* 
based system for decision raakiji^; in the Arialysis Phase of the Instructional Systems 
Development (ISD). hv ordcn^ to make logical and objective decisions based on conditions 
and needs in the lield you niust collect, organize, analyze, and docunient job significant 
data (Inforaifvciou). Such data includes many specifics under the broad categories of 
job backgi'ound dat^, targ'^t population data, and critical teak data. The specifications 
of specific data requirements and sources of this data should be part of the overall 
Job Analysis Plan, 



\ 
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WHAT ARB SOME SOURCES OF M SJGNmCANT PATAf ? 

There are many sources of data to support a job aiialysia/ 

These sources include such things as: . . 

; • Tech: .cal Manuals \ 

• Field Man^s . j 

• Army Regulations 

• Circulars and Phamplets \ 

• Proems of Instruction \ 
® Soldier^i Manuals 

• Previous Tmk Lim \ ^ 

• Documentation from the Systems Engincfering Era 

• Reports from outside agencies, i.e., ^my Research Institute, HuniRRO, 
and other military and civilian research organizations 

« Intemal Research Reports \ _ 

• Tables of Organization and Equipment'and Tables of Distribution and 
Allowances 

• Civilian Publications (technical joiunals and "professional publications.) 

• Equipment Modification Work Orders 
^ ^ CODAP (Cornprthensive Occupational Data Analysis ftopams) 

• Field Survey^ , 

• Panels of Experts \ ^ 



mtCH SOURCES OF VATA ARE WCLUVBV W THB RESOUmE 
MANUAL? 1 ■ 

Each of the sources listed is useful for fulfiUini specWic needs in the Analysis Phase 
of ISD. The Job Analysis Pkn should specify exactly which items of data will be needed 
and^the recommended source(s) for each item. In this way aU the data can be accessed and 
ready for use as soon as it is needed. The last three sourek on the list CODAP Field 
Surveys, and Consensus Groups or Panels, are frequently cited in the Job Aids for 
specific Items of mfonnation. How to use these sources is khe subject of this manual 



19 



27 



ERIC 



WHAT IS COVAP? 



To provide persunRel mana.ger5 and training managers with tho reUablt^ job dsui 
needed for job and task analysis, the Deputy Chief of Suaff for Personnel has selected the 
occupational sun^ey questionnaire for data collection and CODAP (Comprehensive 
Occupaticnai Data Analysis Programs? as the system for processing, reporting, and anaJ- 
ysmg this data. The combination of ^^stionnaire and CODAP is currently being used by 
all the U.S. Armed Forces to support occupational survey and job analysis efforts. 

This automatti'd data system provides information in such areas as: duties and tasks 
performed by job and duty incumbents; types of equipment, tools, and vehicles used 
and maintained; special skills and knowledge which must be met by job inciimbents; 
quality and quantity of training received or required; physical and mental demands; and 
special items n >: lainina to personal and job backpound information, work environment, 
and job satistactior^. 
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mEN SHOLILV COVA? PsEPORTS BE UStPf 



Whenever data has already been prepared by CODAP it should be used in preference 
to school conducted surveys in order to prevent duplication- of effort. CODAP has the 
capability of supplying all your data needs. It is the responsibility of each Army service 
school to initially provide the Army Occupational Survey Program with the input it must 
have to supply your job rinalysis needs, and also to develop a job analysis plan which 
'ows sufficient time X-:. acc^^^s the necessary data. 

Of particuJar use :n job analysis are Group Sumniarv' Reports, The Job Aids 
^^gest that you obtain these reports for documenting such inforrnation as: ^ tasks 
L-irformed in each duty poration (ask for GPSUM6 repart for your MOS), and percentage 
of soldiers in the skill level performing each task (ask fcr GPSUM 2),* Given sufficient 
lead time CODAP can also make up special reports to provide ratings on task selection 
factors such as, time to train OJE, consequences of inadequate performance, and proba- 
bility of emerfency performance (ask for FACSUM report). 



In order to obtain CODAP data you should first check v^ith your sur>er\'isor to see if 
the information you need has already been accessed. If it has not. %vrite to: 



Commander 

US Army Military Personnel Center 
ATTiN: DAPC^MSP^D 
2641 Eisenhower Avenue 
AleKandria, VA 22311 



AUov^^ at least three weeks for the reports to arrive at your school. The necessary- 
lead tim.e could be much longer if you are requesting special information which CODAP 

not yet collected. It is recommended that you obtain the two official piides from 
MILPERCEN: the US Army Military Occupational Da a Bank, and the US Army Occupa^ 
tionai Survey Program. 



*Keep in mind that these percentages are based on the peacetime conditions in which soldiers are 
presently being surveyi^. Adjustments should be made for combat tasks. 



HOW ARE COVAP REPORTS OETAIMEV? 



or caU: 



325-9272/9493 (AUTO VON 221-^9272/9493). 
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iOHAT IS A WRhiAL FJcLV SimMVf 



A formal field sun'ey is simiiar to :hG type of quesdonnaire survey conducted by 
the Arniy Occiipationa] Sun-ey Prc^m, only it is conductad by instructional development 
personnel within an Array service schooL 

The use of questionnaires permits the job analysis team to make limited contact with 
la^-ge numbers of personnel; thuj Inxge amounts of information can be collected at a rela^ 
tively low cost. Questionnaires can be mailed to personnel who ai'e asked to complete 
and return them, or they can be administered to groups of job incumbents and/or super- 
visors by local personnel who have the responsibility and authority to make sure all 
questionnaires are completed and retunied. 



Ulienever time does not allow you to access irifomntion from the Aimy Occupa^ 
tional Sur\'ey Program, an alternate data coriection meth d may be used. Formal field 
.iur/eys ar^ suggested as an aiLernate ciaia source m the It^.,. Job Aidi^. Shu aid you decide 
to conduct a formal field sur\^ey be sure to obtain permission from MILPERCEN in 
accordance with the guidelines in AR 600-46, 



WHEhl SHOULV for/Ml FIELV Si/K(/cKS BE USW? 




HOOJ IS A FJBLV SURUEV QUESTlONNAJnE VESlGMEV? 



o Types of Qu&stionnaires 

Ihere are t\vo types uf questionnairei, ihe club-^d foriri and the open form. We 
sugiiesi using the domd fonn, which contains a list of possible items to be selected or 
blanks to be filled in with words or numbers. (For an example of a closed form ques- 
uonnaire, see Appendix Aj This form has several advantafss over the other aitemative, 
the open form. It is likely to take a mininiurii amount of time to fill out, thus Lncreasing 
the chances that it will be completed and returned. The process of tabulating and sum^ 
marizmp responses is simpler and less time consuming than with an open form questionnaire. 
Mrichine tabulation and computer analysis of the completed forms are practical when a 
Large number of quesrionnaires is used. 

A properly designed closed form questionnaire is difficult to prepare. The desipier 
must be sure to include all possible responses expecied from any of the soldiers who^ 
will com.plete the questionnaire. The items must be constructed on the form so that 
they clearly communicate to the user exactly what the designer is trying to ask. The 
peatest sinclo problem with research methods is improperly worded questionnaires, as they 
produce fauiiy data, if you mienu to design your own questionnaires we suggest consult^ 
ing the following guides; 

Morsh, J.E. tuid Archer, W.B. Procedural guide for conducting occupational 
surveys m the United States Air Force ( PRL-TR^67a 1). Lackland Air 
Force Base, Texas; Personnel Research Laborato^% rospace Medical 
Dinsion, Air Force Systems Command. Septamber a. .. 

Jacobs, T.O. Developing questionnaire items: how to do^ it well Human 
Re urces Research Organization (HumRRO), 300 North Washington Street, 
Alexandria, Virginia 22314. 
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WHAT SMOULP BE JNCLUVEV ON THE QUESnOmmRt? 



The cietaiis of the forms you use wiU be detemmed by: 

1. how you will tabulate and summarize the results, and 

2. what information you msh to coUect, 

How you will tabulate and summ^ze results will be chitarmlned by whether you 
have available a computer and other automated data handling equipment and by the 
number of people surveyed. To ditsrmine what information you wish to GOllect, you 
should ronsidar the total data requirement for the training dsvelapment promu. Them 
data rtquircments should be predetermined in the job analyiii plan so that as much infor- 
mation as possihie mn be obttined in a single questionnaire lurvay effort. 

One note of caution about the design of your questionnaire is that you should keep 
the questionnaire as short m pmctical. In general, the fonns should be designed so they 
can be compieted in two hours or less. One way you cajn save time on a complex 
task inventor\^ is to list r.". tasks under their appropriate duty position title. This 
will permit the soldier to rapidly scan groups of tasks not performed and then pro- 
ceed to the next duty position. 



WHAT TYPE 0¥ WSTRUCTiOm FOR COMPtETIWG ANV 

MUInISTEkWG the QJJESTlONnAlkES SHOUlD be mEPARW? 



After the formal field survey questionnaires have been written, the instructions for 
completinf^ and administering the questionnaires should be prepared, These instructions 
should include: 



For the user 



an introduction explaining the purpose and 
importance of participating in the field sur\'ey. 



— ger ral instructions explaining how the questiotinaire 
is to be completed. 



© For the project officer 



^ general instructions regarding responsibilities. 



(When questionnaire is 
not self*administered) 



^ specific instoictions for administaring the ques- 
tionnaire in a controlled environment. 



For examples of these types of instructions, see Appendix B. 
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WliJ IS A SLlKl'BV SAsiPLE SBLECTEV^ 

lyii noNv rea::y lo J^a.'^; w:;.::inizauon? and inui%^iJuaU :o nmvidt^ vou vith t.ht^ 
nv^ccd job dau. The L'ornpiuxity of :he MOri, the availabUit%' ajid' quaiitv of DUhUsht^d 
^nurues ul job mion-ation, and the number of people m the panicular lob will ^i^rmme 
now mucn ana wna: Kinds of information you need w collect. This will strong- 
mn-ience the makeHip and size of your sainple. thy comnlexitv and amoujirof required 
uana are gr^ai, :n^^ numuer of organisations and individuab inten^iewed will inrrease As 
a eon^ral rule, your sujvev sample should be 06 larpe as possible. This is particularly tru- 
u you do not hav^ per^nnel available with the responsibilitv and authnntv to a.^ur^ ibat 
most of your quesuonnaires will be completed. Vou should make an attempt to obtain a 
sample that represents the distnbution of individuals in the MOS according lo command 
and skill leveL Re%iew of personnel records, either by personnel emplovt^s, members of 
your job analysis team, or your field representatives who will conduct the sun-v will b^ 
requirea to otjiain data upon which to bas^ choices for your sunTv. 

^ In seiectmg UNITS for sampling, you should select units that; 

L have at legist a small number of job holders and supervisors who do the 
panicular job lo bt^ analyzed. Prererably, ynu should choos- som- nn:t. 
ir ,: nave a relatively small number of job holders, and some thai nave 
irirae numbers. 

2. are ceo|n-aphically anu environmentally represenuuive. 

o In selectmK INDIVIDUALS within the umts. you should select a -roun mad. up 
ol mdivnduals who: 

1. perform and supervise the job bemp: analyzed 

2. perform with average satisfactory^ proficiency 

3. are representative m rerms of leninh of time on the job 

4. are representative in terms of training. 

For certain types of mformation you will also want to choose at leaM a fev. job holders or 
super^'isors who are acknowledged experts at the job. 
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HOiiJ IS A QUESrtOmAUE SURVEY COhnUCTEV? 



Trie! Run (Valldotion of instruments) 

Before sending out the total number of questionnairas you intend using, you rnay 
wish to ssnd out a small numbar. This ^vill permit you to check the initial results ajid 
possibly make some changes in your questionnairas or iristri.ictions. Then you wHl send 
out what you hope will be the total number of questicnnaires required. 

o Group Administration 

The ideal way to ridminister questionnaires is poup administration. Where the 
local responsible official and his assistants schedule the administration he should do 
the follomng: 

= Make certain that only eligible individuals are seated in the administration areo 
^ Read the administrative instructions 

Provide any necessary assistance in conipleting the questionnaires 
= Rotum the completed questionnaires to the school 



© Individual Administration 

Olten, particuiarly with Individuais at remoie stations, group adrainistration is 
impractical. In these cases, it is sometimes effective to send the questionnaires to a 
responsible officer .and request that they be retunied by a reasonable suspense date. 
Careful attention should be paid to the instructions for administration or self- 
administration. If your command no authority to require that a suspense date 
be met, then you must either obWn the conctirrence of a command with that 
authority, or be willing to accept a reduced percentage return, 

o Return of Quostlonnaires 

How much confidence can you have in the validity of your questionnaire if you 
get less than a 100 percent return? Less and less confidence can be expected ^vitii each 
reduction in the percentage retunied. What can you do if you are not satisfied with the 
percentage of returns of the questionniires? We suggest you t^ the following: 

1) Send out more foirms to different people and hope for better results, 

2) Recontect some of the first sample and t^ to encou^^e them to return 
the questionnaires. 

3) Visit a random sample of those who did not respond and compare their 
forced responses with the voluntary responses. Then you and your super- 
visors will have to decide how much chmce you are willing to take that 
the data you have received presents a sufficiently accurate picture of the 
job as it really exists. 
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O/HAT IS A PAWEL OF EXPERTS? 

With thii method a group of perionnel, selected for their experience and knowlediie 
of the jab, is brought together to confer about the required job analysis data. Panels may 
ba ui. up of one or more of the foUowing types of rr.ambers: 

1 ) Subject Mattar Experts (SMEs ) 

These ?xe parsonnel found at your school who are acknovviedged experts, 
in the tasks, duty positiunG or MOS :^ou are analysing. Tliey may be 
found among instructors or ISD personnel wno hold the MOS. SMEs 
may or may not have had recent field experience, 

2 ' :?b Incumbents 



This group inciudes those who are nresantly holding the jobs/performing 
the tasks/ you utq interested in, or who have recently held the job:^. Tne 
more recent the better. More than three years avv^ay from the field would 
disqualify a potantial panel member, 

- ^ Job Supe rvi sors 

This group includes those who are pres^ently or have recently (within the 
past three years) supemsad soldiers in the jobs/tasks you are interest^ in. 

Job incumbents and job supemsors may be found on the post 'where your school is 
located or at other locations. Check the TCEs and TOAs to find out where personnel 
mny be assigned. While personnol assigned to your po:t are most convsniently assembled, 
they may not be compietely represen^tive of job incumbents/supervisors serving in o*h'^r 
locations. Also, they probably have been heavily burdened by school sun^eys, pa : h\ '' lu. 
already due to their proximity to the schooL Therefore, personnel from other locaiions 
ma%' have to be used. 
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^^'WtW IS A PAHBL USEV? 

Panels of t..pens ■ a good dternaw data souice when: 

- CODAP is i:r;t availabk' 

- time and funds are inadequate for conductinf^ a field survey 

- the type of mformation requL-d can be reliably provided by 3 small group 



WWEA/ m SUBJECT MATrm EKPERTS USEV? 

With this method, a poup of highly axperienced personnel is brought togeth-r to 

co^leciS^I °hTl'" """^^"^ method is particularly useful in 

cc^lecnng job data on new jobs or on manaserial and supervisory jobs wh«e many of 
the most cntical behavion are not directly observable. Since the membars of a panel of 
SMEs axe experts m the MOS beini analyzed, their colL-ctive effort should be de^.^on 
.w..a. .n^ .w.qujw^i^«nts 01 cne jo j. in general, their greatest effectiveness is in evaluatinc 
and makmg deas.ons about job data that hare b.en collected from other sources by 
other means. " ^ ■' 



wi'-i. ,,.ww^,j, ^ulj A/WuUinota'/i ^,nV/uk Sut^tKVlSORS USBV? 

With this method a poUp of job incumbent, job supemsors, or a oombLnation of 
U.^ese .s brought together to provide information about their jobs. The primary funcuon 
of this type of pane^l IS to provide information about their jobs, not to make decisions 
Another name for this type of panel is Consensus Grouo 



HOW IS A PANEL ASSEmLEV? 

The panel ij a relatively inexpensive and saay approach to coUecting flata Three to 
seven persons is the number recommended to make up the panel. Whenever possible you 

^v, , ^® representative of different locations and types of units in the 

field. While many experts may be avaikble within your school it is critical that their 
vnews be balanced by those of persons serving presently or recently in the field If all of 
the panel members come from schools, there may be a tendency for the outcome to reflect 
what exists m training rather than what actually exists on the job. 
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JOB INVENTORY 

lOUTY-TAiK LISTI 
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Appindix B 

APMIfilSTiATIVE PROCEDUBiS 



mm mm questionnaire 



t. Introduetion (for umr of questionnaire) 

2. GenenI InrtruGtions (for umr of quertionniir©) 

3. General Ini^uctjoni (for project off lew) 

4. Speeifio In^uatloni for Administering Queftjonniire 
(for project offmr when questionnaire Is admini^sred 
in a controlled environment. 
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TO: USER OF QUiSTIONNAIRE 



INTRODUCTION 



TO THE NONCOMMISSIONED OFPICER! 

This questionnaire is part of a field survey desifned to identify tasks for mllita^ 
police training. Its specific purpose is to obtain from you, the Noncommissioned Officer, 
mformation on task criticality and frequency of performance, Ferfback gained from 
this questionnaije will play a major part in redesigning the Noncommissioned Officer 
Advanced Education Sys^ra. The ultimate goal is to design training so that it reflects 
what we have lesuTied from you in the field. This gosd if possible only with your fuU 
cooperation. Consider each task listed in this questionnaire carefully and give your best 
response, Your contribtition is essential to a successfuJ survey. 



31. 




TO: USER OF QUESTIONNAIRE 



GENiRAU INSTRUCTIONS 

1. Complete this survey questionnairt within the time specified by your unit project 
officer and return it to him upon completion. 

2. Because instructions for completing each part of this suwey questionnairB are 
different, read aU instructions caref 



Part 11 requires that you supply biographica] information. This information wiU be 
used to correlate feedbacl: received from the field. PMt all answers in the spaces 
provided on the appropriate survey questionnaire page. 

In the upper right comer of each page of Part III, Task Inventory, of this survey 
questionnaire is a BOOKLET NUMBER block. Immediately to the left of this 
block :s the mdmdual booklet number. Print the individual booklet number in the 
BOOKLET NUMBER block on each page of the Task Inventory as demonstmted in 
the exiunple, 



EXAMPLE: 



(000345) 





BOOKLET NUMBER 




0 1 


2 


m 


4 5 


6 


7 


8 


9 




0 1 


'2 ' 


3 


m 5 


6 


7 


8 


9 


__ . 


0 1 


2 


3 


4 ■ 


6 


7 


8 


9 



Part III, Task Inventory, is divided into nine (9) separate sections (Sections MX) 
The content of these sections concerns tasks you may perfonn in your present duty 
assignment. You are asked to rate each task in accordance with three criteria - 
frequency of task performance, immediacy of task performance, and importance of 
task to mission success. \ 

\ 

Base all selections on your experience in your pyesent duty assignment. 

a. Column A requires that you rate how often Wu perform each task on a scale 
from one to four. The criterion for this ratln^.^U the frequency of task per- . 
formance. Those tasks performed most frequently win normally be rated four 
while those tasks not performed at all will be rated one. ~~ 
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b. Column B requires that you determine how soon you must be capable of per- 
fonning each task after reporting to yoi^ present duty Alignment, The eri- 
tarion for ttiis rating is the immediacy of task performance. Of the four 
possible responses, select the one most ne^ly describing your requifements. 
Select response number four for those tasks which you must be capable of 
perforaiing immediately upon reporting for duty. Select response numter one 
for those tasks which you never perform. 

c, Colimn C requires^that you descrite, in your opinion, how importrnt each 
task is to mission success. The criterion for this mting m the importance of 
the task to the accomplishment of the unit mtasion. Those tasks that, m 
your opinion, are most importent to mis^on succe^ will be rated four while 
those tasks that you consider least important will be rated one . 

6. After selecting, enter your responses for each task, using either a pen or pencil, in 
the answer portion adjacent to the appropriate task statement m demonstrated in 
the example, 

EXAMPLE : The task PREPARE CORRESPONDENCE , if rated as performed 

FREQUENTX.Y in Column A, identified m must be capable of performing 
IMMEDIATELY in Column B, and d^temiined by you to be MOST 
IMPORTANT in Column C, would be enters in the Mswer portion, as 
shown below, 

PREPARE CORRESPONDENCE 1 2 3 4 1 2 3 4 1 2 3 4 




7. After each section of Part III, Task Inventory, is a Write-In Section, These write-in 
sections ^e proinded in order that you may comment on each tesk Inventory section, 
or list any task(s) you think should be included in the Task Inventory. These sections 
also allow you to comment on those tasks that you find are the most difficult for 
you to perfonn. 
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TO: PROJECT OFFICER 



GENERAL INSTRUCTIONS FOR PROJiCT dPFICER 

Gperal. The Military Police School is eiOTently involved in redtsigning basic 
military police training to produce military policemen better equipped to perform 
when they reach the unit. The emphasis is toward training replacements In tasks 
actually being performed in the field. The questionnaires in this packet are designed 
to identify those tasks. 

The cBre with which you, the project officer, administer the questionnaires wiU 
determine the accuracy of field feedback and, CDniequently, the success or failure 
of this project* 

Survey Packet Contents . 

a. Questionnaire 

b. Super^sor Questionnaire 

c. Project Officer Instnictions 

d. Answer Sheets for Questionnaire 

e. Pencils for use on answer sheets. 

Eesponsibilities . 

a. Unit Commander. The unit commander ii requested to appoint a project officer 
and to monitor administration of the survey, 

fa. Project Officer. The project officer is responsible for the control and h^dling 
of questionnaires, for the administration of the quiitionnairei, md for returning 
completed and unused questionnaires to the Militoy Police SchooL 



Questionnair e Administrator . The project officer may appoint someone to 
administer the questionnaire, if necess^. Normally, however, it is recom- 
mended that the project officer adminiiter the questionnaire himself. 

About the Questionnaires , 

a. ^estionnaire. This questionnaire is desipied to identify teaks being perform^ 
by militav poUcemen in the field and the frequency with which each task 
is perform^, 



Supervisor Questionnaire. The supervisor questionnaire is propammed to pro 
vide feedback on task crlticality, probabiUty of deficient performance, m 
frequency with which each task is performed. / 
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5. ^Vho Takes The Questionnaire. The proje^ct offlcer is responsibli for selecting 
individuals to take the questionnaires (respondents) withiii their uniti. Those 
selected muit meet the requirements listed below: 

a. The questionnaire reipondent must: 

(1) Be in m M.P. duty alignment (actually perfoming duties) 

(2) Have been on the job at lea^t 90 days 

b. The respondent to the Su^rvisor Questionnaire must: 

(1) Command or supervi^ M.P. personnel 

(2) Have been in a command or supervlaory position in the unit for 90 dayg= 
(Asfiign questionnaires proportionately among officers and NCO's.) 

6. Questionnaire Administration . 

a. Questionnaire . The questionnaire will be administered in a conteoUed envtfon- 
ment. Persons participating in the survey will be allowed two hoitfs to complete 
the questionnaire and will turn the questionnaire and answer sheets in to the 
questionnaire administrator prior to "leaving the si^ey area. Individual question- 
naires and the^ accompanying answer sheets will be kept together. 

See attached Item for the procedure to be followed in administering the 
questionnaire. 

b. Supervisor Qutstionnaire . Supervisors selected m respondent for this ques- 
tionnaire will be allowed to sign for the questionnaire and take it with them. 
They will complete the questionnaire and return It to the project officer within 
a time frame he specifies. This time frame must be compatible with the 
suspense date to the Military Police SchooL 

1. Questionnaire Handling . Questionnaires and Mswer sheets become FOR OFFICIAL 
USE ONLY when complete. For ease of accounting, each questionnaire and its 
accompanying answer sheets are numbered. All qutitlonnfires must b# returned to 
the Military Police School whether they are used or not. Instaactions for retimiing 
the questionnaires to the Military PoUce School are con^ned in the basic letter. 
If you have any probleins or questions, contact (NOTE: Give name or names, 
address, and telephone number). ^ 
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TO: PROJiCT OFFICER ADMINISTERING QUESTIONNAIRE IN A CONTROLLED 
ENVIRONMENT . i nwuucij 



ADMINISTERING THE QUiSTIONNAIRE 

A-i. Preparation. A classroom or training room equipped with desks will provide the 
most Ideal site for administering the questionnaire. Questionnaires, answer sheets, 
and two electrographic pencils should be issued to participants after everyone who 
IS to take the questionnaire has arrived. This ensures that everyone starts together. 

A-2. Instructions . The questionnaire administrator will present the following Instructions. 

a. "Is there, anyone here who is not working in an M.P. dutj' position' Is there 
anyone here who has not been assigned to their present duties at least 90 days' 
If so, please leave at this time." 

b. •'Win everyone at this tune please read the first paBe in the questionnaire which 

been issued to you." ^ 

(Note to the.adminis^tor: It must be emphasized that your enthusiasm for 
this project or lack of it will be contagious. It is importot that you demon- 
sirate a positive attitude to the participants. Allow time for the first page to 
be read and underline the importance of the questionnaire with the foUowing 
statement.) » - - - m 

"I would like to stress the importance of this questionnaire. The MUitary 
Police School wants to design training to fit the job in the field You are 
the only people who can tell them what they need to know. Please think 
through each question and give your best answers." 

"Turn to Part I, Biographicaa Information, and answer questions 1-13 
When you have finished, lay your pencil on the desk so I will know when 
to proce^ to the next step." 

"Now read the instructions found in Part 11." 

(Note to the administrator: Allow reasonable time for everyone to finish before 
moving to the next step.) 

"Are there any questions?" 

"As you read in the insttuctions. there are nine answer sheets accompanying 
your questionnaire. Take the answer sheets and number them one through 
nme to correspond to the first nine sections in Part III of the questionnaire 
If you do not have nine answer sheets, raise your hand-I have extra ones 
Use a separate answer sheet for each section. Answer only the number of 
questions listed in each and move to the next section and answer sheet It 
is not necessa^ to write your name, rank, the date, or course at the top 
of the answer sheet. Also, disregard the blocks marked score, grade, extra ' 
points , and social security number." - — — ■ 



c. 
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f. **Because of the siEi of this survey, these mswer sheets will be read by 
machine. You must me the special pencils provided so that the machine can 
read the answers. When marking your answer, take care to fill the vertical 
rectangle outlining the letter as shown by the example on page 4 of the 
instructions. Also, please be sure not to make any stray m^ks on the 
answer sheets. Finally, do not fold the Mswer sheets.*' 

g. **A11 answers must be based on your experience in this your present unit. Do 
not call on experience in previous uniU. This means that if you do not per^ 
form a particular task in your present unii, you must mwfk *do not perform 
this t^k' on your answer sheet." 

h. '*You may begin answering IIL Remember Section ten, the written 
section. When you finish answering all questions, insert your answer 
sheets into the questionnaire and turn them in to me. You may leave 
when you are finished. Are there any questions?" 

A'3 Conclusion . After everyone has taken the questionnaire, ensure that all ques- 
tTonnaires and answer sheets ^e accounted for. Collect the pencils provided so 
that they may be returned to the Milit^ Police School along with the question- 
naires and answer sheets. 
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JOB AID FOR 
DiVELOPING OBJECTIVES 



ISD IM 
Manual 

This ii the^Sth In a series of ISD Job Aids for use in instructional design and 
development. This volume is to be used as a iupplement to the prima^ document, 
**Job Aids: Descriptive Authoring Flowcharts ISD ILl Develop Objectives." The ' 
flowchart document will direct you to specific guidance, examples, and references pro 
yided in this volume. If you do not have the prima^ flowchart document, request 
it from your supervisor. ' 



The wording In this manual should not be ^nstru^ to 
diigriminate between thi sexei. In order to avoid a 
ripititlous use of tht terminology, "he/she," the tirmi, 
"he," "him" and "his," as well as "men," are intend^ 
to Includi both the mainline ind feminine gender. Any 
exceptions to this usage will be so notid« 



E-1 
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ISD 11.1 DEVELOP OBJbu VeS 
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• Thii intpaduetign pfsvidti Ihg u{|r wiih 
iniiruLimn an Iht QiWi %\iiii\uit at 
Jcb Aidi tnd guidjncg lor Ihfir uit 



• Riitr IQ IfilPDduifioti 



to block 3 
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1-3 



ffsm block 2 



IJilJ Th i Jul ■ -. \* 



to blQek 6 



{;<!*! 

Mjjui ijrpi in ppotfU 



'mX M tke.- Job Aid £ok 'iVzveZop Obj^aZlva^" all abouX? 

%^ • GOAL 

~ The purpose of this job aid is twofold, First, it will guide you in the actual 
writing of correctly stated learning objectives. Second, it will explain the 
niechanics of deriving learning objectives from Task Summary Sheets by means 
of learning analysis. 

NOTE THAT LEARNING ANALYSIS IS DIFFERENT PROM TASK ANALYSIS. 

= Performing a task and learning to perform a task are two different things 
Details of how a task is performed, from the first -step to the last have already 
been carefully documented in the products of ISD 1,3 (the Task 'Analysis Work- 
, Sheet and the Task Summary Sheet). In order .to design instruction to train 
soldiers to perform the tasks on the job, it is necessary tb translate TASKS into 
TERMINAL LEARNING OBJECTIVES (TLOs) and task ELEMENTS and certain 
onablmg SKILLS and KNOWLEDGES, into LEARNING OBJECTIVES (LOs) 
All of these learning objectives (both TLOs and LOs) describe what a soldier 
nuisj be able to do during and at the completion of training, 

= Thus,the task analysis describes the task in its on^he-job performance sequence 
while the learning analysis describes the task in its complexity sequence In ' 
learning analysis, the most complex skill, the task itself is broken down into 
all Its simpler skills until the entry level skills of the target population are 
reached. (Entry level skills are skills which the trainees already possess and 
therefore do not require training.) 

- Later, in ISD II.4, Sequence and Structure Objectives, the order in which the 
learning objectives are most easily learned is determined. 
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Summary of tho differences between these three Bteps# 



ISD Block 



.3 Conduct Task Analyiis 



.1 Develop Objectives 



1,4 Sequence and Structure Objectives 



Analysis 
Task of 
Based on: 



Performance Sequence 



Partiaf 
Learning Sequence 



Complete 
Learning Sequence 



TLO 
LO 
LO 
LO 
LO 
LO 
LO 
LO 
LO 
LO 
LO 



1.0 Lubricate fittings on car 

1.1 Assembre equipment 

1.2 Use fittings lhart 

1.3 Identify fittings 
L4 Locate fittings 

1 J Clean fittings 

1,B Operate lube gun 

1 J Charge fittings 

1.8 Wipe fittings 

1.9 CieanJube gun 

1.10 Replace equipment 



1,0 



Comptex 



1,1 1,4 1,5 1,7 1,10 



1,3 



1,6 i.n 



1,2 



Simple 



SHORTHAND PYRAMID 
DERIVED BY LIARNING 
ANALYSIS 



1,0 Lubricate fittings on car 

Grcup One Objectives 

1,2 

1,3 

1,4 

Group Two Oblectiyes 

1,6 

1,8 

1,7 

1J 

Group Three Objectives 

h^ 
1,10 



OBJECTIVES 
1) 



( 



Given a list of task statements, translate them into correctly stated terminal 
learning objectives with their enabling learning objectives. 

2) Given the appropriate v^orksheets, document for each task the enabling skills 
and knowledges derived by learning analysis, and the learning objectives needed, 
to train the task. 



WORKSHEETS USED 



Examples of worksheets used in this block can be found as follows; 



1)' 
2) 



Learning Objectives Documentation Sheet, shown on page E-T. ' 
3" X 5" Learning Pyramid cards, shown on page E-S. 
Th^ Shorthand Pyramid, which displays the learning analysis, may be 
developed and shown, on any large sheet of paper. We suggest Using 
newsprint, or butcher paper, about 2 feet x 3 feet. Each task element.«nd 
each enabhng skill and knowledge is written in short form (action statement 
only), on the 3 x 5" cards provided with this job aid and taped on the 
large sheet of paper. In this way it can be changed if 'needed as the 
pyramid develops. (If space permits, the cards can be arranged on a table ' 
.top or bulletin board. They are easier to work with when not taped down.) 

_ r ■ 

• DESCRIPTIVE FLOWCHART 

■ - The nowchart oji pages £-79 and E-SO shows the steps in the. use of the job 
aid for developmg objectives. The flowch£irt will be useful to you in genine 
a clear picture of the overall process used in this job aid. A more completely 
■ described flowchart is provided in Job Aids: Descriptive Authoring Flowcharts 
ibU 11.1 Develop Objectives pages E-S thru E-IS. 



E.6 
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Example (Partiuliy Completed i 



iSD II 1 Develop Obif'cti v»j5 

LEARNING OBJECTIVES DOCUMENTATION SHEET 



3^o- r7s - /Dai ^s-hityi-i&'s 



A Joof 
I oof 



HiVffe 4*^r+^ pa<X 



1^ ^etj/^i I ^i''/ 



5d 



E-7 



White LP Card 
(Exampie) 



T.isk it 


Group Letter 


Instructianal Setting 


Sequence # 


Learning Objnctive #_ 




Action Statem^dnt; 




Vellow LP Card 
(Example) 


Task # 

Ejement/Enabling S8tK # 


Group Letter 


Learning CategofY/Subcatenary 


SequencB # 


Learning Objective # _ 





Actian StitemBnt; 



— — = ^ ^ I 
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Example: 



SHORTHAND PYRAMiD (Learning Analysis) 



IfJTEPPRET 
MAP 



□ RIENT MAP 



USE COMPA^t^ 



HIKE Wi TH HACK 



USE LEGEND 



SYSTEM 



WATCH SyMBOLS 
TC ACTUAL 
TEflRAtN 



MATCH SYMBOLS 
TO LEGENU 



CO 



MfcAU COMPASS 



SIGHT 

caMPASs 



APPLY FUJLES 
FOn USING 
COMPASS 



HEAU COMPASS 
VALUES FROM 
SCALE 



ALIGN PUiNTS 
Vyi TH SCAl E 



AVQlO MAGNETIC 
ATTflAC I IONS 



ifllNTiFY 
SVMflOLS 



HIAU VAl UE5 
INTEHPOLATIDN 



APPLY RULiS 
I Q H U I f { [ C f I Q <i 
FOR Hf:AOINr* 



TO SYMPl If Y THIS 
EXAMPLE THESE 

iif\is HAVL uin 

llMiTTED 



tOENTlFY 
COLORS 



! rj E N T I F ¥ 
StJAPES 



illENTiFY 
GRAOUATION 
MARKS 



lOENTlFY 
I E H 0 
HEFEHENCt 
PntNT 



iDENTrf Y 
liLUE POINrfcil 
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E.9 



from blocks 3 nnd 4 



to block 8 
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from ijlocks S .-jruJ 9 



WhaX .Ob the. /leZajUomlUp fae-ftoeew a ta^k ^.tautrnzivt 
and .lU teAmlnaZ le.ajLning objta.tlv^ {TLO]f 

e Both tusk stLitements and TLOs consist of the same three parts: 



Conditions Stateniint 


Action Statement 


Standards Statement 


Dfi^icrtiiliun of thu coiujiuonis) 
of perrgrmaiice-What is presented 
to the soidier 


Dt'scrifitiun of the action or 
behaviQr--What the soldier is 
expected to do 

— ~ 1 


A statement of the output or 
outcomB of the performonce and 
the standard(s) of performance 



Thu terminal learning objouiive may be identical to the task statement or it may 
lie a modified verHion, depending upon how practical it is to obtain on-the-job 
performanee in the training setting. The following discussion of the levels of 
objectives will clarify this point. 
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o LKVKLH OK OBJEC L I ViiJS: ()i)jui'tivorf can bo written at Kuvural different levels. 
.lL\s important, to Linderstand what theso levels are because they iu-q the hiisis of 
test and course development. Undorstanding these levels can also help you judge 
the adequacy of the objectives. 

Level 1 Objectives - Task Statements 

Level 1 objectives tell what must be done on the job. These aro tl aetuai 
task statements prepared by the job /task analyst in the Job Analysis phase, 
ISD LI. Statements of the critical tasks, selected for training in ISO L2, are 
the inputs to this job aid, 

== Level 2 Objectives - Terminal Leaning Objectives (TLOs) 

Level 2 objectives are essentially Level 1 objectives which may be modified to 
match the training resources and .sul ety requiremenLs, L evel 2 objectiv^es je ll 
wha t a soldier must be ab le to do at the end of trai ning , not necessarily in 
an operational environment (on-the-job). TLOs are outputs of this job aid, 

=^ Level 3 Objectives - Leaniing Objectives (LOs) 

Level 3 objectives refer to the enabling skills/ knowledges for the whole task, 
which are not directly useful by themselves. These are iranslated from the 
task elements and certain skills/knowledges which must be leai^ned in order to 
|3erform the elements = Thus, Level 3 objectives tell what a Boldier must do 
and know (skills and knowledges) as a prerequisite for doing Level 2 
objectives, LOs are also outputs of this job aid. 
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o 'Huis, m many casus tho 'J-LO and the task statomfint will bo idi-ntica! because - 
tlie laslcH iiicmselvps mn bo duplicated in iho training environment In tliose 
cases there is no need to write a now TLO, the task siatoment is the TLO 

o In oUior eases, only portions of the netual required behavior, coiiditions, nnd 
Standards from the job world can be reijresenimi in the sehool setting. Then the 
behavior, and/or eonditioris and/or standards may require revision to mnko (hem 
conipatihle with tluj training environment. 

o In .still otiier cases, the terniinal IcaiTiinij objectives (TLOs) will represent the 
behavior aceuraloly, but will not require the ultimate level of proficiency that 
IS required on the job. In many troubleshooting, maintenance, and repair tasks 
job conditions require speed and proficiency which cannoL readily be nehieved ' 
m school. It is ejcpected that these high levels of speed and proficiency will be 
nehieved on the job nltur initial school trainiiig. 

a Thus, when any portion of the task statement must bo changed to meet the 
requiromnnts/limitations of the training situation, your aim is to nrovido practical 
high fidelity incasujemont alternatives, (TLOs which approximate' the task as ' ' 
nearly as possible). 



G2 



from block 10 



tn block )7 



W/ie/Le can 1 obt±xin a LmJiyUng Objuctivz Voam&ntatlon S/iee^/ 

o LOD 8h(*eiH are avaihu)ie for duplication in the pocket at the back of this manual. 
© To ^iM' an example of a piunially eonipletud LOD Sheet, refer to page E^7, 
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E,!5 



frgm hieck 1 1 



to block 1 3 



iiJhcU. dot6 -t/ie leoAfUkg Objzctlvt VQcmzyita.tion Sliett 
took tike. Lokm Secttan I /icti been aompl^te.d? 



EXAMPLE: 



ISD II 1 Dr.v,-lnf, Oh,i-c-<.,vc% ■ 

LEARNING OBIECTiyES DOCUMffiTATiOH SHEET 



6S 



from block 12 



[ Sri: Tjji 



'-vn,.i it LfHi '"K. 



to block 15 
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WiiaX dou LOV ShcQ^t look tike, wkm icuk nmboji and 
J,yi6tA,mtion.aZ. ie-ttaig oAo. /iQ.coKded .In Szatlan T1? 



tXAMPLE: 



ISD II 1 Drvclop Ubioclivot. 

mmrn obiectives DocuuEfnATioJi sheet 



71 t Jph^i 
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from block. 14 

1 

tl -''Tin M.r:M;.*. tUIj 
j! '*;.>rMri ft Llin^f-n-r 

to bloc k 1 6 



aaXA.on 4.tatejfim%t £o/l the. TLO? 

^ Look only at4he action statement of the task, (conditions and standards state- 
ments will be considerod soparately). Is this an action which could he performed 
in a training setting? If so, accept the action st.itement for the task as the m-tion 
.statement tor the TLO. If this action could not be ,,erformed as stated in tlie 
training setting you must modify it, (This would be very unusual since most 
uctions could be performed in the training environment with modification of 
only the conditions and standards). 

^ For example, you could accept this action statement: Load, reduce a stoppage 
unload, and clear an M60 machine gun. ' 

You could not accept this one: 

Shoot known enemy personnel. 

Thi^ Htatement would have to bo modified. 



If you decide to rewrite the action statement, study the following guidelines: 
The ACTION statement tells what the trainee does. 

~ Every objccUve (whether TLO or LO) should state precisely what the trainer 
must do. Ihe statement of performance must be clear enough for that per= 
formance to be trained and tested, Examples of porformances stated in objec. 



® Climb the lephone pole 
® DiBassemble an M06 rifle 

Statf^ conditions fur which a tourniquet should be applied 
Camouflage the helmet 
Add two fivedigit numbera. 
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1) Use an action^ verb \ 

Note in the examples on the previous page that every statement of per- 
form:ince inelucleK an action verb. This verb usually is the key to the per^ 
formance. It tells what must be done. For example, in the statement of ' 
performanue, '"State conditions for vs^hich a tourniquet should be applied," 
the action verb is **State." You caji test a soldier-s ability to state these 
conditions. Suppose that the statement of performance had read, ''Under- _ 
stand the condiuons for v^hjch a tourniquet should be applied," W^uld you 
know v^hat to test? How would you know when a student ''Understands" 
the conditions? By using an action verb the performance becomes both 
measurable and observable. 

2) Clarify main intent if necessary by using an indicator. Sometimes the 
action verb is not the key to the performance to be trained and tested. It 
may be only the indicato r of the performance. Any time that you can't 
point to the performance itself^ the action vcirb should specnfy the appropri- 
ate indicator of that performance. For example, consider the statement of 
performance "Add two five-digit numbers. It is clear that the performance 
called for is "adding," But how do you know when someone successfully 
adds two numbers? Obviously, an indicator must be supplied, since you can't 
observe the act of adding. So you would attach an indicator to the statement 
of performance; i,e,, "Add two five-digit numbers and write the answer in 
the space below." Note that although ''write , , ," is the observable action, 
the main intent of the performance is adding, not writing. If the statement 
of performance calls for an action (has a main intent) that is not directly 
observable, an appropriate indicator must be added, 

3) Select verbs which reflect the type of learning, i.e,, Mental, Physical or Attitudinal 

When the expected performance has been successfully analyzed into the proper 
types of learning, you can indicate clearly what it is that the trainee is to do. 
\ These indications require precise statements. Each action statement can contain 
tw o verbs . The first may indicate the kind of objective that is being written 
(see examples on the ndxt'page) and the second will indicate how the trainee will 
perform the action indicated. The exception occurs when therc^can be no con- 
fusion: ''Sing the Star Spangled Banner." But, "Describe the relationship 
between . . , could easily mean either orally or in writing. So, if there can be any 
dnubt alioul the intention, use a second verb to indicate what the trainee is to do. 
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Examples of Suitable yerbs for Each of the Three Types of Objectives 



Menral Skill 


? Physical Skill 


Attitude 


Stite 


Execute 


Choose 


Name 


Operate 


Vol u nteer 


Recite 


Repair 


Allow 


Describe / 


Adjust ^ 


Recommend 


List 


Manipulate 


Defend 


Tell 


Handle 


Endorse 


Write 


Manufacture 


Cooperate 


Demonstrate 


Calibrate 


Accept 


Discrirriinate 


Remove 


Decide to 


Clesiify 


Replace 


Agree 


Generaie (a solution) 




Apply (a rule) 








Solve 








Derive 






/ 


Prove 








Analyze 1 








Evaluate 1 









• More guidelines for Writing action statements arc given in block 40 of this job aid. 



E.22 



ERIC 



What dou^ 

EXAMPLE: 



e LOV ShteX look Hke. fA)km the. TLO aation 
ha6 been KtcoKdzd? 



ISD II I DevDiop Ob]0C!iyeg 

LEARNING OBjECTIVES DOCUMEKTATION SHEET 











i 










i i HMlKlAl 1 1 AUMifJi. iiii PI 1 t i.y i ~ 








<te p^M^ ^^^^ 










SI L riciN III ^ 
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E.23 



from block 15 



CrjtiiiKtriti SfiilPfitiirH lt>f 
IE«U>u>M!. LUUShk-uij 



■> Fur gtijirsince in rtf lefmit-wng sfieiher !he (aiii. Eiiiiiliiioni liaieiiirttf n iUmsUe 
it ftfi!<tigf!!nd!f!ijni liaiBftit;:!! *hEM rnjceUdtY 



to block 1 7 



How do I d^ddz wheXheA to aaatpt oK n^mnAto. tkt toMk 
aondutLon 4tatme.nt {ok the. TLO? 

® Look at the TLO action statement you have just recorded. Could the conditions 
stated for the task be duplicated Jn the training environment for the TLO action? 

For example: 

TLO/Task Action: Load, reduce a stoppage, unload, and cleai- an M60 

machine gun. 

Task Conditions: Given an assembled and cleared M60 machine gun, and any 
amount of linked caliber 7.62mm ammunition, and a 
requirement to expend all rounds in the belt, 

TLO conditions may have to be modified in this case as follovirs' 

Given an assembled and cleared machine gun, and any amount of 

linked caliber 7.62mm dummy rounds ammunition, and a requirement to 
expend all rounds in belt. 

® If you decide to revt^rite the conditions statement, study the following guidelines: 

• The CONDITIONS statement tells all of the conditions and limitations which 
affect the performance. 

— This portion of the learning objective describes the important aspects of the per- 
forniBnce environment. What does the trainee have to work with? Can he 
select his own tools? Are technical orders or checklists available as a starting 
point? The conditions portion of the learning objective should specify the objec 
events, words, or symbols which will be presented to the traim^ Consider 
the instructional setting when determining conditions as they \v idicate what 
is available. 

A terminal learning objecLive (TLO) or learning objective (LO) may require 
more than one statement of condition in order to secure the desired action. 
On the other hand, in some cases the condition may be implied, as in the case 
of ''Recite the C3ettysburg Address," the condition "from memory'' may be 
omitted since it is implied by the verb "recite." 
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Sample Statements of Conditions are Shown Below: 

Sample Statement of Training Conditions 



GOAL 


EXAMPLE 


State the conditions imposBd 
upon the trainee. 


"Given the diameter of a sphere and the apprapriato 
formula, CQmputi the surfacR area of the sphere. 

The trainee does not h^ve to memnrize or derive the 
formula. He solves the problem using the formula 
provided. 


Do not overuse the word "given." 
Use variQtions. 


"Field strip and assemble an M-16A1 rifle under 
conditions of total darkness.** 

This implies that the trainee will be provided with the 
rifle, and requires that he strip and assemble the weapon 
in complete darkness. 


Establish the working conditions. 


"Using available library resources prepare a staff study 
comparing the communications support contributions 
made by five military leaders during the nineteenth 
century/' 



® More guidelines for writing conditions statements are given in block 42 of this 
job aid. 



\ 



( 
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WkaX do £4 the. LOV Shtzt look Ukt wkm 
' ^taXm&yiX to been K^aoH.dQ,d? 

Example: 



tkz. TLO c.oncUM.on6 



ISD II 1 Develop Objectives 

LEARNINO OBJECTIVES DOCUMENTITIOH SHEET 



m.. . ^..^C ^i^^ J^h^s^n 
Land Navi^^^^n..^HiU3 



•itLTHiH It 

If ffMlHAL LfflHfiifjG rSEjjFt;Tl Vf. 

A.j.,. ^t.^.^ tr^th^t^MJl J}fK% PPM^ A^t^pPMt JB 
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from block 16 



1 i 



Aitfpl/ljl Wilis U\i. 
SlJtiiytrh S!i!im«nl Ijt 



■ Fiji gyirynGl in dEij>immmq whtmEl }hi iilk liifldirdi iUliSmFnl rl KtcpUtiif 



to bjoek 18 



Hoa; do I decide iA)h&tk^ ^ acaept oK KmHJXt tko. task 
standoAds 6tatme.nt ioK the. TLO? 



• Look at Ihp TLO action and conditions statement you have just recorded. Are 
the standards given for the task realiBtic and achievablo for the TLO action and 
conditions in the training environment? 

For exaniple: 



TLO Conditions: Given an assembled and cleared M60 machine gun and any amount 
of linked caliber 7.62mm dum my rounds ammunition, and a 
requirement to expend all rounds in the belt. 

Task Standards: Load and clear weapon within 5 seconds. 

TLO standards may have to be modified so that they are achievable by the new 
trainee. You may want to modify as follows: 

TLO Standards: Load and clear weapon within 10 seconds , 

• If you decide to rewrite the standards statement, study the following guidelines: 

ir 



TLO Action- 



Load, reduce a stoppage, unload, and clear an M60 machine gun. 
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E.27 



• The STANDARDS statemunt tells the standard (criteriorO by which the perf( 
ance is evaluated. 



The (Titeria for standards--uompleteness, aecuracy and time are summarized 
in the table below. 



Criteria for Standards in Objectives 



CRITERIA FOR 
GOOD STANPARDS 


WHAT IS SPECIFIED 


Completeness 


The precise nature of the output. 

Number of features that output must contain. 

Number of steps, paints, pieces, etc, that must be 
covered or produced. 

Any quantitative statement that indicates acceptable 
portion of total. 


AccuriCy 


How close to correct the performance must be. 

Exact number! reflecting tolerances, 

Valuei or dimensioni that acceptable answers/performance 
can assume. (These may be qualitative.) 


Time 


How many days^ hours^ minutes, or seconds can be used. 



Cheek the standards statement to see that it includes quantitative terms when- 
ever possible. Remember, however, that some standards are not directly 
quantifiable, such as: 

a. adjusting a earburetor until the engine runs at its smoothest point 

b. making a patient feel comfortable (you could follow a procedure but not 
succeed if you were ho.^tile). 

• More guidelines for writing standards statements are included in block 44 of 
this job aid. 
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ijJhat dou tkt LOV SkzU look Uke wkm thu' TlO 

Example: 

4 ISD n 1 Develop Objectives 

LEARNING OBJECTIVES DOCUMENTATION SHEET 



■"il f f Plipi 




























Him, +^^*Wr»st w/7/ htK*^ 4^p#*i Pst^* A P&^'* G 
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from block 1? 

4_ 



r!hi hiNti hefjmi il.M \Uin:!>q Ji'jl^vi \,>i,iv:% i,>irtui,q fifiaf,i,i ,i j Ejrjiih..- 



mi ,ii 

MjiiinjI^ iialijiiti II.ii;£(j! 3' 
i i i jyid^iitt^ III! ijlii.jHiiMii 



tu biQck 19 



py/Lamtm and whzAe. do I obtain thm? . 



• You will ncod Luaming Pyramid (LP) Cards, one whitei and many 
a large' wori< space, , 



ow, and 



• I he iGarning analysis you are about to construct for each task elempnt may 
require a large amount of space. The task element itself and em h enabline skill 
and knowledge (for at least two levels of analysis) arc r rd,H^ on the 3" x's" 
yellow Learning Pyramid Cards available for duplicatiuh .he pocket at the 
back of this manual. Obtain about 30 at a time. Obtain one white card for the 
task action statement. 

• You should have a large surface available on which to arrange the cards from the 
task element at the top, down to the entry level pn ruquisite skills/knowledges 
required to perform the element, at the bottom. A de.sk or table top. or large 
bulletin board is ideal. However, since such space is not likely to be availabt 
you can also use butcher paper or newsprint, approximately 2 feet by 3 feet 
Ihe cards can be taped to the paper. In this way the paper, with the completed 
learning pyramid, can bo moved about or even stored away. 
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E-30 



from block 18 




m.ds tfitili on fthith uu nbi??, ifiiitueiitjfSiJi icftmti. I«atfitnij uhitctNf 
'f UMiift riitfjl tin tvhitli f the Usfe Mutiihei i| nTtittJpiJ ifi thiS ilisp 




T 



to block 20 



WkoAt do I ob^txln and hou) do I KmoKd Inio^atlon on 
LP CaAd6? 



Only one white card is used per task as it represents the terminal learning 
objective (TLO). When all the learning pyramids constructed for each element 
are combined, in a later step, the white card is placed at the top. 

What to record in this step 

1) Task number (shown on LOD Sheet) 

2) Instructional Setting (shown on LOD Sheet) 

3) Learning Objective Number (last 4 digits of task number) 

4) TLQ Action Statement (shown on LOD Sheet) 

• Yellow Cards 
^ Purpose 

The yellow cards are used to actually build the pyramids. There is no way of 
knowing how many you will need, but only 30 is suggested as a start. 

What to record in this step 

For every yellow card you use, it is necessary to record: 

1) Task number (shown on LOD Sheet and white LP card) 



• White Cards 



Purpose 
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i^hjzt do tkt u}l%U^ and yMoiM LP acuid^ look llk^? 



White LP Card 




(Example) 




Task# 330'-r7r- /oof 


Group Lfitier 


Instructionai Settinn S4'^U'^t b n 


Soquonce # 


Learning Objectivo # /OO P 




Antion Statemeni: 







Yellow LP Card 
(EKample) 





Task^ 33^- S"7f - /^O^ 






ElBmint/Enablinq SgiK ^ 


Group Letter 


\ 

1 


Learning Category/Subcategarv^ 


Sequence #. 


I 

\ 

\ 


Learning OblectivB # 




\ 


Action Statement: 




\ 


s 





so 



ERIC 



from hlock 19 



?,!.i|ti/11,!|y ^iffeiii 



if!! 1 .fi.S.i-LlliJi jrfl!!f!i 



to block 21 



on the. Toife SmmaAij She.eX? ^ ' 

• Rcmd the lAonwni to see if it describes a unitary action (one action) or compound 
ac tion.!; (more than one). You will find that many of the performance measures 
on th.o Task Summary Sheets are written as compound elements. For example: 

/rask At'tion Ktatement: ''Install the M16A bounding antipersonnel mine 
with and without tripwiroH/' 

Tlu^ rirHt i)erfornianL'e mc^asure to this task consists of compound elements: 
''Inspect and fuse the mine.'' 

This comiiound element must be rewritten and analyzed as two unitary elements. 
You will construct a learning pyramid tor each one. 



from block 20 
I 



to block 22 



Hou)^U an oZmtnt maon^d&d ion. the. LmnyUng Pymmid? 

' Pv^nfiV h''"?'"- °' ^'^^ ^'^'"^"t ^^I'the yellow Learning 
For Example:- 



r 



Task # 33^^r7.r- 

Eliment/Enabtmg SIlK #_ 



Learning CategQrv/SubcatBgQry 
I Learning Objective # l _ 



Action Statement: 



Group Letter, 
Siquence # 



m^ss 
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from hitKjK 21 



b!ui:k 23 



Hoiv do I Idavtt^y tkt iQ^aAyiing and 4ufa- 

© Thi' chart on the iirxt pa^o shows the throu Ituirning catugories: mental, physical 
aiul attitiuiinaL AlthDUgh the Job Aid for ISD II LI, Specify Learning Events and 
Aetivities, givi's a et/iiii)lete explanation of learning categorieB/subcategories, and 
how to ichMitify them, at this point yoii should have a basic idea of what they are. 
'rhis will h£*lp you to write objectives which more accn>-?tely deBcribe the desired 
lu'liavior. For instant^e, if the task calls for tuning an - ^ine, you will need some 
learning objectivcg which describe the various mental skills involved, and of course 
some responsive motor skills. You may also want to teach the attitudinal likill 
of appreciating the importance of a well tuned engine. ThQ re-son for being aware 
of these different c^ategories/subcategories is to prevent you from writing an 
objective like ''state the steps in tuning an engine," as a TLO if you really want 
the person to acb,ally tune the engine, ^ -State the sLeps . , may be one of the 
LOh involving the mental category of recalling information, hut it does not match 
the dcnsirud task performance. 



Do 



[= E A R N 1 N G 

CATEGQ RY 


LEARNING 
SUBCATEGORY 


DEFINITION 

OF SUBCATEGORY 


SAMPLE 
ACTION VERBS 




idLTltlf yifU) ubjiJCtS 

ijiid sydibuls 


whiMU-UfT ,\ JKirf iri l!-'> r niiiof'-ti 
ytfii^.MLvi.i y jjuHllLUIul UU)L*Ll! 

syrnbul is presi?nted 


IdfJFitify 
bitiirpfet 

Read 




f r;L.jH lfi!| 


rr?puuting nuininn/od infniniejtmn 
ornlly or in writing 


List 

Sr:!tn 

R, ■ i 1 

r I i. i,, ! i ti 

Definu 










cliscriniinatinf] 


whrifi pfusLMHijd with lionis thnt 
iippnar tu be siniHar, idiintifynuj 
ihn difffirnncos hetwnrMi TlifMn 


Moiiiior 
Distioguisf] 
Dniuct 
DiscriiTiinate 


MENTAL 


i'UisSifyifin 


when prcsnntGd with items that 
anpuarjLi bu different, idiiiitifying 
the ffiQlLtrns which they have iri 
CLinimu n 


Identify 

Recognize 

Classify 




rulf!-l{;'nrfiifuj 


StntHifj wvlion and how u prinuiple 
oppiies to Q given situotion 


Suli^ct 
Prudici 
Dfjtef mine 
Specify 
Apply 




dt:t:iSKjn-iru]king 


specifying a cuurse of action fur usn' 
!ti a prnblfim Situation 


Clio use 

Dncide 

Fnrniulate 

Selfjct 

Evaluate 


I 

PHYSICAL 




intjyinQ oil or parts nf tfie body m 
Order to nnrfarni a set action 


Cut 
Weld 
Saw 
□ rill 

Splice 
Draw 




uoiiir :^kd| 


fTiavnuj nil or pcjrts of tho body in 
fHspnnse to cantMUmily cbanning 
cues to actioi'i 


\ rack 

Control 

Steer 

Guide 

Reijulate 


AT'niUOmAL 

— . . ._ 


ttltUd»)=lHfU?M|K| 

I 


ixhibitinn a patlorn of behavior or 
jf resijoiise towards sufnettiin;] 


Accept 
'Joinpiy with 



^4 



AfU'T kn)kin*^ at llu* rharl yon may iVi^l ii is cliffitaili to (^iuosc a hpinalic cali* 
OrU'ii wurvv Uiaii anv iy\)v uT Icarniii^ 1^ rallvd lor. "Wwn you musi srUnM iht> 
unv that iiiosl i'lo^t'h- in:\\chi'^ thr (lo.iriHl l)i^h:ivi()i\ 



Example: 



Tn.k ^36r £2£r- /^^c£. 

Eiemniit/Enablinn S&K 



Laarning Qhifjctivt} ^- 



Group Liittur . 



Action StatGiiifini: 



o Soto 11) !hr pxampk^ that M stanfls fay mcMUuK You may winh to use* P for 
pWyHical, and A for attitiulinaL 



i ■ 




HoLO do I make cihsuunptiom aooat ^t/ie zivtAtf 6lu.tU ayid 
biotaC idge th^ tiLn.gU popLLtatlon? 

o Kiury l)i'jiavit)r iiu^lLuics iho skills, inrorniatiuii and atliuicios that a solclic»r 
pusHOHSf's at ihv iimv hv crimes for inHtrLu:tiun . Or coursu Ihuro will bo some 
variation of iMiiry luOmviurH but the task should bv broken down to the poinL 
wlii mm^pYiispvvUvv trainees have the prerequisite skills, knowh^dges and 
altitudes. " ; 

o Make assumptions un information ahuut tne personal qualifieatJons of soldiers in 
this MOS and skill level, as stated in the job deseription. Consider such thlngH as: 

reading h*vel 
- atniiude reniiirenienis 

f>ric)r <^xf)iTienc(* and trainini^ 
aeadenn^ rec[uirt^nents 

^ TfiM.n assumptions will assist you in jud^in^ how far down your learning analysis 
should go. For (»xamnle, skill level one tasks may require training for fundamental 
anions that you would not inelude if V(ui were rloin^^ a learning analysis for 
skill levi^l 3. ' ' 



86 

E.38 

o 

ERIC 



^fcjfn b\ocK 23 



HoLO d T peA{)Om ItaJiyilng ayialifsLi on a mife QZmznXf? 

o 1'hink ul)out what Homuono woulcl havo to bp ablu to do or know beforo ho could 
at^compliHh ihiH stop. In oUut wurths what are the enabling skills and knowledgus? 
Write tlu' aetiun HtaLumunts niily on l.inirning Pyrainid ( LP) C'anU, 



Example: Hf^for-^ h(^ can do thi^ ~ 



[i-iif MAP 



r 



Hp ncu'ds to know/dp tluH 
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E-39 



thrniiLrh at h^uM iwo sulsnnliiUitf U^s^i'k^ nv pvuit rurtlior if ihv .'iiiry lov(»l skillH/ 
iih-it^ ilh- M' yrlluv." ciiYih^ (y^Ui [KH nvv-d to nuHjnl tfu* IfanUiii: calt'^ory/ 



EXAMPLE; 









1 M Ml 111 A Nfl'i 







i ll ! >'f)i'jjt H 



E.4Q 



S8 



ft urn bUu:k ?A 



Hoiu do I combine, tlit t(i.aAiilng pi/w^muls? 

o VuLi hiivi: htuMi iuHtructi'd to nuikc' ^t^pardlc pynimids fur rat-h task cU'imMit. Now 
you watu to hIiow tin- task as a whole by lining uj) ihv pyramids side by side 
iiinlrr Ifu' I'lA) arii'Mi stdlvmcni (on whitf' r(irdi. 



EXAMPLE: 



lihif N! VAP 



MAI CM t^VMHfit S 



MA ! i:H liVVHU I 



:::t: 



f;{SMPA?;'> 



□_ 



I U t N T I f Y 



AVU'U MAtiNtl 
A I f HAL 



Ciil UMii 



Ml AN VAiiil S 



Af'fM V fPil M; j 
F mi liiNf I ii.r. j 
I f)H M! AiiiNr; J 



fVAS'PtF, IHfiU 
! ri M?; HAVF iiK N 



ffif snry 

SiHAlUjA i ION 
MAf^KS 



HE Ff. R{ N(.i 
Hf)iN T 



« lion* you can scm^ thn complete imk broken down into all of its ojoments and (Miiiblin^ 
skills and knf)wlnd^os to the point of your inmn population's assumed entry levpb 
'rhis will help you eheek your learning analvHis for eonipleteness and neeurary. 
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ERIC 



^ Proceduraj Steps 



L Line up pyramidH siclo by sidf^ unclur the 'VLO aclian statumer.;. 'rhis may be 
.1 Hale uiirieuit (leptMuiin^ on haw many levels of enabling Hkills and kno\vled«^eri 
Ihere are. Just try to display the '^hole task as clearly as possible, 

2. Now you ean assign a number to each enaliling skill and knowledge. The 
letter/numher eombinatiun in the example on the following page is suggested. 
Haeh task element is assigned a letter AT^C, etc. The sub^ulements which make up 
the elem(Mit are speeified by pr-faeing them ^ ih the letter of th element 
rallovved by the appropriate cieeimal numbering. 



so 



EKAMPLE; 



VIA ) Art inn - Ui Iriilrni 



S" iiU'liU'iit s 



I 



1 ^."-^U:. 
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E.43 



ERIC 



iiJhcU d,-'c^ the LP Ca.^Ld took C-t/ce Lvkm tlid (Licmenf/ 

mabung bLUL and bwicUdqe i(Ltt(LX/ nLunbcA is 'n.ecG^ded' 

EXAMPLE:: 



Lrjrfiintj UtijiiCtivi ■ 
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03 



E»45 



f^jm til' 



34 



E..i6 



ERIC 



ram hiack 2H 



I 



ERIC 



bin,..-, 



W/ia-t 00 66 tlia LOV S/ieit loolz ttfee Lvktii an Ummt 
cLdtian s.o''.tejmiit ,/iai been ^leao^dedf 



EXAMPLE: 



ISD 11 1 Di'volop Oi: :,;.t:tivDr, 

LEARNING OBJECTIVES DOCUMENTATION SHEET 



J30^S )S- /OOP XnSHiutr^n 

f^/i^y-r^Mc^ Will hiK^ pfit^f A to ps^nh B 



06 



from biqnk 30 



cfoei the LOV S/icet look ,tcfoe u)km tke. IgxtMiaig 
caXe.goxi/ and iubaatcgo'tif ^o^ an eXeme/tt lias bc.aC 
xcao X-diid? 



EXAMPLE; 



ISD II I Duvelop ObiiTtiVi.., 

LEARNING OBJECTIVES DOCUMEHTATIOfl SHEET 



■ SFC Albert Teh 



$%p^5^ir- loop 



iui^hih 3 hours 



11/ ?^ 



07 



&.4 9 



EKLC 



what dotb tli^ LOV SliceX look ILka ickeji aU (inabtoig 

biLLtt^ and kncLVtedgn f^o^ an e.Zcmait /laue bcieu xccotdeA 



EXAMPLE: 
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LEARNING OBJECTIVES DOCUMEHIAIIOH SHEET 




3 SO ■ r 7 ^ -iec} i' 5 + .' ^un on 








; 


1 


4 / 




'% t f 

Us* /ej*^^^ 
A ,J 1 




/ C ^ t ^ 1 




A I i L i.. f 




^ ' / /. / i / 
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ffurri hJack 34 



I-- 




Haw do I de^Wwund 1^ an objacUvt ihouZd 6e imMttm? 

* !.n-,M'l'T T p':, ' ''"T'f " """'^'''^ necessary tu show all c-lomonLK unci 
tt) wrili" an oljjcrlivi" for onvh (jf thiisc 

* Write a IcaniinK objodivc. for an clement or its enalil.ng skills anci knowlcdgns when: 

1) It is a riUTICAL KLKMKNT, or SKI LI./KNOWLEDGE hclnnKinK tn a 
critical (■lenient. Critieal elements were identiricHl in ISD Block 13 Task 
Analysis, as those task elements which have one or more of the fullowine 
charaeleristics: ' ^ 

u) They are one of the most measurable and observable olementK of the tusk. 
i)) I'hey have serious eonsequences of inadeqiiate porformanee. 
<■) rhey are common soi'rees of failure. 

These criti.^al element, were marked with an asterisk on the Task Kummarv 
Hiieets, ., ' 

2) It is an action which the soldiers of the target poi)uiation do not already 
know how to do and must thereforu be taught. 

:i) An objective has not already been written for this elomont or c?nabling 

skdl/knowledge. You will often find several enabling skills/knowledges whieh 
are eommon to more than one element. For exampk.; in the task "tune a 
V-8 engine" it is necessary to use a feeler gauge to; 

a) set i)oint gap 

b) set spark plug gap 
e) adjust values 

In the leai-ning analysis it is necessary to record the use nf the feeler gauge 
for several eh-monts. Ifowever, it is only necussary to write one learninR 
Ohjec-tive, Thi.s boeomes a COMMON ELEMENT OKJRC'JMVE ^' 
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loo 



EXAMPLE: 



L() -2 Set spark filui^ gap 



L( -^3 Adjust valves 



LO -I A 



LO 



LO ^3.1 



LO ^M.Ll - 



LO ^^2.1.1 



{ I J .se \ij vlvv ^ a u ) 



Only Olio ohjtH^tivo is wriLtt^n tor use of feeler gauge in this itmk. When objectives 
are grouped and soquenced in ISD Bluek IL 1, Secjurnice and Strueture Objectives, 
rnatiy objeetives will be* conniiun tu a grciup of task^^. At that time more objectives 
will l>e identified as common element and grouped together so that they are only 
taught once. 
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^■''^'^ i'l^LOV S/Leet lock UU lokm no ^dqaiALinmit 

ocM 41 UaAyiuig cbfeettue .a IncLiaatad? iiJliat dco^ tlw 
LP Catd iook tcfcef 

EXAMPLES: 



LOD Sheet 



A^ / i, L i 



ElniTiont/Enahling SftK /f J, I, j JL^ 
Lfiartiifiy Caiuijury/Suhcatonfiry 



LP Card 



iy 0!.,.:Lnvc ^^ h on e 



Antmn SlcitGffiDiit; 



Group LLMlur 



WkaX do I do tv^li thz LP Cmd6 ujlUch 
teRXiiLng obje^-tLue to be LV/vWtm? 



0 not fitqiii/LQ. a 



I'laci' these ri\r.\u in a separate stas-k f 



rom those whieli do rec|uirc> an olyiM'tivi 
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What daei tkz LP CaM look tcfee ivlmi ItaAiUng 
^/le LOV £oafe .tcfee? 



EXAMPLES: 



Task ^^A'BD- S^lf- JOO^ 



Eluniunt/EiiJljiin^l S&K -^A^LMulJ^ 
Learning Cc3tegQrv/Suhc3tG0ory__._ 



Le/irninn Obiectivu fOQ^^ A. L t. L I 



Action Siatument: 



Grnufj LeilCir 
Scruionco - 



A 






r A 






4 / 






At 




I JO *i 




M-\ \ 


4 ■ f. /= i 






A 1 r j 








' {DOS 


4^i.' 3-- 






AfLiJ 









lU3 



f^^'^^ do T dctdvnLm and /leca^ld tli(L ImAiiinq oRte^qo^uf ^a/i 
mdi ^nabCuig iktLl ayid knoivtddgcS 

o 'lh(^ rharl on the rolhjsvliii^ pauv shown thi* tlinH* main lt>arninn catc^^orioH nnd \\w\r 
^^ul )i'aii*M;f >ru*s. 

s l.ook at thr [irijcjn vvt^rtl mvd in tlu' action HLatonuuiL, Try to di^t'rminf wliat 
type ()!' Irarnni^ is n>cjinnHl lor this i'IcmiumU. OftcMu m()n\than one* typo of 
l^^arnmu is (^alh'c! lor. 'Vhm you must soku'L Lho one* whirh is most ohvious, 

® Mnro mtnrniaiion on uhMitifyinM learning vnimmv^ is ^iv(Mi in Manual IHD IlIJ, 
Sprcily L(^arniny Kv(Mits/ Ati ivit j(^s, or you may rptVr to pago K^3b in Huh manual. 
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LtAHNlNU 
CATEGORY 


LfcAHNiNG 
SUBCATEGORY 


DEFlNlTiQN 
OF SUBCATEGORY 


j SAMPLE 
1 ACTION VERBS 


MENTAL 


idernifying ohjeij?s 
and syfnbols 


givnin uny unyarymq respnfist* 
whtinyyur a particukir abjDct/ 
synibui is presented 


Idyniffy 
interpftji 
■ 1 e u I J 


recallinn 
inlOFfntiiiun 


renentinn mniiinfi^tMl if'fnrni^t. mi 
urally or in vvninig 


State 
Recite 
D ef i F'l e 


discnminatinc] 


when presented with items tliai 
appear to be simSlpr, identifying 
the differences between them 


Mpnitor 
Distinguish 
Detnct 
Discriniinate 


cidssifyirin 


when presented with items that 
nppfiiir to bfi dfffernnf, identifyinn 
the features which ihey have in 

CQiiimun 


Identify 

Recorjfti/n 

Classify 


rule learn inn 
and usifig 


slating when and haw a prmciple 
applies to a givenjj^tuatmfi 


Select 

Predict 

Determine 

Specify 

Apply 


dHCtSiniviTiaking 


specifying a course of actinn \[u use 
in a problem siTuatian 


ChoDse 

Decide 

Formulate 

Select 

Evniuaty 






fjrfJSS fnytuf 
skill 


movmriall nr parts nt imm bady ni 
order tu perform a set auiinn 


Cut 

Weld 

Saw 

Drill 

Splice 

Draw 


PHYSICAL 


ffjs[junr.ive 
mntnr skill 


moving all or parts uf tlie body in 

rnsnnnitn tn nnntinijaNy chcinying 
cues tg action 


Track 

Cuntrgi 

Steer 

Guide 

Regulato 




ATTITIJDINAL 


ittitude-leafniiin 


nxbibiting a pattern of behavior or 
of rBSponsR tnwarfls sornfitbing 


Accept 
Chonse 
Comply with 



o 
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luit do tilt LOV S/ie£,t and LP Ca.xdh loolz Lika Lvkm 
t/ie tm^iUng catiigoALf and 6ubc.a,tQ,go^^ij axe ^inaoMdzd? 

EXAMPLES 



LOD Sheet 



A 



A //J - X 
H.f.}l-.l 



fry It 



LP Card 



ElemBnt/Enabling S&K 



(5 



Learning Categorv/Subcategory tD/_^_j€ €^ 4 ^kpJ 
LDarning Objective # A*LI Ij/ } 




Action Statement: 



Grouf) Loiter „ 
Sequenco - _ 
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Tram hirjck 4 7 



HoLC do I Lvn.U^ an LO aation iiattnmit? 

e Genvval ku 'U-lmos tor writinR action statemcMitK for tho tfrmmal U>arnint; ohjtH.iivc 
wi-rt- Miven on paKes K=20. K=21 and E=22. Thc-y are rrvitnvcci and exnanded lu-nv 
\ uu will notice that the sanu- rulun apply to writing Ivoth TLOs and LOs. 

1) , Use AC'TION vorh« 

Write a statement tliai tclis what the trainee does, usinp AC'TION verhs that 



are 



C)BHKR-VAB[JC . Yon am soe the porrormanec 

MKAHURABIJ^ = You can cheek the performanee for eorfcctnej^M" 

RKLIAnLR = Everyone would interpret tne action calied for in 
tile Haniu way, 

2) Describe UNITARY actions 



Wrirc a statement that deHerihes a IJNI7"ARY action. "Load and unload weajH,,,' 
may he the task statemont given in the Soklier's Munual, but when writing 
learninK objectives it sliould lie nuule into two unitary LOs: (a) "Load 
weapon" and (h) "Unload weapon," (Ilaving unitary objectives simplifios 
the job ot the lest item writer since one test item .should not cover two 
actions). 



108 

o 

ERIC 



3) CLA RIFY niain intent if ncH-L^ssary 



Write a statement in which the niain intent is CLEAR and opcratianally 
defined. \ 

\ 

Here are sorne examples of perfornNanee statements in whieli tlie main 
intent is a clearly specified^ directly observable performanci*, 

"Cross a wire uostacle , , The performance called for is crossing a 
wire obstacle aiid that is the main intent. Crossing the wire can be . 
directly observed, 

= Unlock the security container . . Unlocking is diretily obsei%'al)kv 
and the objective's main intent is that a j)erson be able to unlock the 
container, 

= Here is an example of a performance statement in which the main intent 
is clear but the performance called for is an INDICATOR.. 

" "Circle the picture of the proper shears to use for cutting a curved line 
in sheet metal , , 

Circling the picture Is *the performance called for, but certainly not the main 
intent of the objective. The main intent is clear, though=knowing which typ 
of shears to use for the task. If the objective wanted the individual to know' 
which type of shears to use and how to use them, it might have been stated 
as follows: 

= "Given five different types of shears, select the proper shears and cut a 
curved line in the piece of sheet metah" In this case the main intent of 
the performance is cutting a curved line with the appro|jriate shears; 
there is no indicator. 



109 



E.61 



The following are examples of action statements in which the main intent is unclear 
imd no indicator is provided: 

= -'Be aware of techniqucB for setting up a drop zone . . 

"Being aware'' of something is vague and ambiguous. How could a trainee show 
that he is **aware*'? What action is called for? Does the objective want the person to 
be able to set up a drop zone, or supervise setting up, or teacn how to set up a drop 
zone? You can't .tell from the performance statement because the main intent is unclear. 
Also note that there is no indicator provided which would tell you "^nw to measure 
"being aware." 

— "Demonstrate an understanding of the differences between treating a simple 
fracture and a compound fracture . . 

As in the preceding example, the main intent is unclear; you don't really know the 
purpose of the objective. Are you supposed to find out if an individual can treat both 
types of fracture, or are you supposed to see if a person tries to treat a compound 
fracture lilce a simple one? You can*t telL Also there is no indicator to help you figure 
out how you are supposed to measure the ^'demonstration of an understanding/' So 
you really don't have any idea of what performance is called for, though at first 
glance the statement may have appeared to actually state a performance! 

Finally, let's look at some examples of performance statements with clear 
indicators but with unclear main intents. 

Consider this example: 

*'Place a check mark beside the part numbers of the parts needed to replace 
the brush assemblies on the 45 KW generator . , 

Note that the indicator is i)erfectly clear but that the main intent is not readily 
apparent. The main intent could include any of .the following: 

• Be able to select the correct parts for replacing generator brushes, 

• Be able to correctly read and interpret a list of part numbers. 

• Be able to fill out a request for replacement parts, 

• Be able to sort p^s needed for one repair task from parts needed for 
another repair task. 

So you really don't know what the indicator is supposed to indicate. 

llO 



Now look at this example: 

— -'Demonstrate aii understanding of good briefing skills by listing the three 
main parts of a briefing ..." 

Here the indicator is clear: it calls for an observable actHisting, And i might sound 
like the main intent is alear. But is it really? Does 'Misting the three main parts of 
a briefing'' demonstrate an understanding of good briefing skills? Listing the main 
parts of a briefing only indicates an individuars knowledge of such parts, not his 
ability to conduct a successful briefing nor even to recognize whether a particular 
briefing is organized in three parts. Although the main intent is stated, it is not ' 
clear. In any case, the indicator doesn^t even seem to be in the same ballpark. 
The point is that you don*t really know what the main intent is, and the indicator 
is the performance that the person who wrote the objective wants measured and the 
main intent was just poorly stated. Or perhaps the indicator is poor and the main 
intent should be clarified and supported by a different indicator, 

— When the main intent of your objective is unclear, you must revise it. 




4) Use SIMPLE, DIRECT, known performance indicators 

If you must use a performance indicator, check to see that it is SIMPLE 

DIRECT, and SOMETHING THE TRAINEE ALREADY KNOWS HOW ' 
TO DO. i^vvo nww 

If the main intent of the objective is cleai-, you must next ask whether 
It IS overt or covert. An overt main intent is one which is oGServable and 
measurable. In the preceding section, the examples of "cross a wire obstacle" 
and "unlock the security container" were overt main intents. Overt main 
intents do not require indicators: They already tell you what performance 
IS called for and how to measure it. 

Covert main intents require indicators since the performances they require 
are not directly observable. A covert main intent tells you the unobservable 
performance which the objective is about, while its indicator tells you how 
to measure Vi'hether or not an Individual can perform it. 

If your objective's main intent is measured through an indicator , ou should 
make sure that the indicator is appropriate. A good indicator is; " 

- Simple. That is, it is as uncomplicated as possible. You don't want the ■ 

mam intent obscured by an unnecessarily complicated indicator, ' 
= Direct . Indicators are used when the performance called for by the main 
intent of the performance statement is either not directly observable or not 
practical in the testing situation. But the indicator should be as straight. 
■ forward as possible. It should allow you to determine whether or not 

the main intent has 6een satisfied without your having to go through chains 
of inference, 

~ Part of the trainees' nor mal repertoire of behavior . The trainee should be 
able to perform the indicatoT behavior: The indicator behavior itself is 
not what you want to train or test. You only use it as a measure of the 
main intent. So it is important that the indicator is simpler than the main 
intent and that the trainee can do it. If the indicalor were not a part of ' 
the trainee's normal re'pertoire, you would be measuring two things- 
performance on the indicator and performance on the main Intent. 
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Let's analyze some examples of indicators to see if they are as simple and 
direct as possible, and pmt of the normal repertoire. Here's the first example: 

— ''Show that you can recognize the major bones of the human skeletal 
system by drawing a picture of each bone l^eside the names of the bones 
provided on a mimeopaphed handout.'' 

Okay, recognizing bones is the main intent, while drawing pictures of bones 
is how you indicate recognition. Drawing pictures of bones is a direct indi- 
cator in this case, since if a person can draw the correct picture next to the 
name of a bone, you know he can. recognize the bone=you don't have to 
make any inferences. But drawing a picture is not the most simple indicator. 
Worse yet, drawing a bone well enough so that an examiner could identify it 
is not a part of the trainees' normal repertoire unless. the trainees happen to 
be skilled illustrators. Thus, a person could fail to satisfy the objective 
because he can't draw well, not because he can't recopiize the bone. ^ 

In fact, the indicator is a poor one for another reason: The main intent is 
to recognize bones but the indicator requires the person to recall what it 
looks like, then draw it. 

A better indicator for this main intent would be *v ... by writing the name ^ 
of the bone next to the picture of the bone" or, better yet, . by choosing 
the correct name from the list provided and writing it next to the picture of 
the bone," (The pictures of the bones are provided on'^a mimeographed 
handout.) 
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Now consicicr this exrim|)l(:': 

- "Bo ahlo to rreoMnizo properly filk>d=oiit and injproiwi'ly (•ompu'ti.d orders 
Show your ahility to do this by writing pxtim|)les of oaeh," 

The indicutor is "by writinf; examples of oach." 'I'his indicator appuors to 
bt' niMthur simple nor direct. The performanoe eajlod for is q complex one= 
writmg orders-and you would have to infer thnl an individual coidd recoRnize 
proi)erly and improperly filled out orders based on his ability to write 
examples of each. In addition, the indicator behavior required appears toTje 
more difficult than the behavior that the main intent is concerned with-the 
ability to discriminate bfitwecn properly filled out ordDrs and those which have 
not been properly completed. Thus, the indicator is less likely to be a part 
of the individual's repertoire than the main intent; this is exactly the opposite 
of the way. things should be, . 

A bettor indicator would be ". . , sort examples of orders into two 
piles-those that are properly filled out and those that aren't." In this- case 
.all the individual has to do is sort documents-a simple and direct indicator 
of ability tq recognize proper and improper orders. This indicator would 
also be well within the normal behavioral repertoires of most trainees. 

In summary, if the main intent of an oi joctive is covert-not directly meas- 
urable for whatever reason-you should check to be sure that an appropriate 
indicator is included. Such an mdicator will be as simple , and direct a measure 
of the main intent as possible, and will require a behavior which thd trainee 
is able to perform easily. 
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5. Salect VERBS that reflect thu learning category 



Now that the Learning category has been determined you can select an action 
verb that is appropriate to the level of learning. 

— For examples if the task is to prepare subordinate's efficiency reports, 
then the mental subcategory of decision^making is the action to be learned. 
You could write the action statement using two verbs, one for the main 
intent, which identifios the learning sub-category and one for the indicator 
of the performance. Thus, you might write a statement like: Evaluate 
subordinates' performance and write results in the efficiency report. Here 
the action to be learned is evaluate, the indicator is write . 

When the action word is related to the learning category it gives everyone, 
the trainee, the instructors, the course developer, and the test item writer, . 
an exact description of the level and type of learning required. 



from block 42 



• f !ir liiinldiicc ijn hum Ui in dUKijudff find-iiitnl Ujlf (iifr.i. is ttfUm 



t-O biock 44 



Wow do I r;^£ ait Lc? aondUlon 6ta^me.nt? 



pageb b I and E^25, They are reviewed and expanded here, as the same 
rules apply to TLOs and LOs alike. , me bamt 

1) Include in the conditions Btatement all environmental conditionn, inputs and 
limitations do not affect performance. 

a) environmental conditions may include: 
location, indoors or out 
weather, cold, jungle, under water etc. 
time, daylight or blackout 

inputs may include whatevet^P trainee has to work with: 

job aids, chec^lffl^^^ / 
equipment/^ r^/ \ / 
technical r^fer 
special tooli 

") limitations may include: 



b) 




special instructions 

problem situations or continfencies 



2) 



f 



if The Condition Or Standard 


Then This is An Improperly 


Is Intended To State: 


Specified Statement: 


• Given a 45 KW genErator with 


^ Given a malfunctioning 


a broken shaft bearing . . , 


generator . . . 


® , . , under ordinary field con^ 


• . . , under ordinary 


ditions in dayliynt 


conditions 


, . , using a muitinieter and 


• , . , using appropriate 


signal generator only 


test equipment 


• . . , without getting glue on 


• , . , taking proper 


the movable surfaces 


precautions 



Note that appropriate conditions are often related to the level of the objective. For 
example, a Level One Objective, (which m the same as the on4he-job task performance) 
may be to repair any malfunctioning generator. In this case *'given a malfunctioning 
generator" is an appropriate statement of conditionB. However, if the objective is 
a Level Two (TLO) or Level Three (LO), it may be more specific, such as **given 
a 45KW generator with a broken shaft bearing . In this case, any malfunctioning 
generator may not conform to the requirement of being preclBe and specified in 
operational terms. 

3) Note that when the conditions are clearly implied they need not be stated. 
For example, when most tasks are performed in daylight conditions it is not 
necessary to state ''in daylight." Record only those conditions which clearly 
affect how the task Ls performed. 
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to b/ock 45 



Hon) do T w^tCe an 10 6tandajLcU 6taXme,n,t? 



• Gnioral RuitlPlines for writing standaras statements for th(. TLO wort' given on 

S r 'n n'" ""l^' '''''''''^ '^^^''^"^ here, a« the same rules 
apply to I LOs and LOs alike. 

1) Inelude in the standards statement whatever measures . .quate perform 
ancp apply to the task. There are three Renoral typos ot nst-asures' 
cjuant.tative, qualitutive, and time. On the foIlowinH pam are listed more 
SI • ific types and examt les of standards. 
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DESCRIBE STANDARDS 
BY 


EXAMPLE 


Referring tu o Slandard 
Operating Procedure 


"Given the situationai requirements for an Instrument 
approach, and the local airfield regulations, perform the 
procedure the pilot follovvs to complete an instrument 
landing. The performed steps will be in correct order and 
will comply with local regulafions/' 


Implying the standard of 
NO ERROR 


"Given the diameter of a sphere ond the appropriate 
formula, use a calculator to compile to two decimal places 
the surface area of the sphgri/' AdL^ing "He will perform ' 
without error" would not increase the requirement for 
accuracy. 


Cpecitying minimurn 
acceptable level of 
performance 


"Using a slide rule, multiply two three-digit numbers and 
write the answer to the nearest tenth." This clearly states 
the degree of accuracy required for satisfactory achievement 
of the Dbjective. 


Specifying the time 
requirementii 


"Given a 200 word rough ^raft, type a letter without error - 
at a minimum speed of 40 words per minute." Time is an 
Important factor, so it Is included In the objeciive. 


Specifying the rite of *' 
productiun , ^ 


"Given a roilgh draft of a findl report type pages without 
error at a minimum of 20 pages per day." The amount 
' produced daily is an important factor so it is included in 
the objective. 


Specifying qualitative 
requirernenis 


"Given a misadjusted carburetor and necessary tools, adjust 
the carburetor to idle at Its smoothest point."^' ^Smoothness 
is a qualitative standard. 



2) State the standards in preciKO, operational ternifi. After writing the standardH 
statenient ask yourself, '^Does it really tell mn all I need to know to eHtahlish 
proper standards, or would someone else have to fill in the deiaiis/' Knio 
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that appro|)riate standards are often related to the level of the objective. 
For oxuiiiple. a Level One objective (which is the same aa on-the-job task 
performance) may be to type a letter witho ut er yo^at a minimum speed of 
40 wor ds per mi nute. In this case, the stand^d is appropriat£^. However, 
if the objective is a Level Two (TLO) or Level Three (LO), the standard may 
l)e more lenient. Many tasks require long practice before the task standard 
can be met. In the example just given a more appropriate standard might ' 
be **with 3 or loss errors at a minimum speed of 30 word^ per minute,'* 

3) Note that when the standards are clearly implied they need not be stated. 

For example, ''Given a chart showing Army rank insignia, identify those which 
correspond to grades E-1 through Here it is not necessary to state the 

standard corrcfjtly. This is clearly impMed, 
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from block 44 



Uj bk^Lk 46 



What do, I look Ion. wktn (u^eA^blng' tke. LO ^04 adtqmaij? 

• Tho following fihefJkHst will identify for you at a glance, all the fuaturos of a 
'welUwritten learning objective (TLO or LO) suggestod m this job aid, 

1, Does the objective eontain the'throe main parts of action, TOnditiuns and 
standards? (4 he seeond and third partH may be implied or may be previously 
stated on the LOD Sheet) 

2. Is the objective unitary? (Does it specify a single action? See page K-GO 
for review). ^ ^ 

3, Is the main intent of the objective clear? (Does it state preeisely what- the 
trainee ig to do? Siee pages E-61 thru 10^63 for review.) - 

4. If the main intent action word i^equiros an indicatok action 'word/ls the 
indicator clear, direct, and something the trainee already knows how to do? 
(See pages E-64 thru E-66 for review.) 



5, Is the action word appropriatt* for the type and level of learning called for 
by the task? (See page E-67 for review, ) 

6. Are actions, conditions and Btandards i'uch stated in precise, operational 
tcjms? 
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t... 
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^hout do £-6 -t/ie LOV ShzeJ: took IMze, w/ien an LO ,t-5 ^n^mo^ded? 



EXAMPLE.- 



ISD I! 1 Develop Obieclivcs 

LEARNING OBIECTIVES DOCUHENTATIOH SHEET 




r.' b!:>r.[. h(} 



•I 
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^ In Mrdt J' Inr llu' inHcriKnional Ss slunis nrvt'lopnUMit prcu-t'ris la wcjrk i^fftH'tively 
It l^ inip<M-ativ;^ that thrPt> rurward ami ba('!- -/ard c'animuiii(-alion h^'tweiMi the 
pv()\i\v ]nvt)l\'i'd in tht' pruceHS. At h(>mu tinu^ .;r nther you have |inihahly rnnv 
pi:anfM! :ii^a\ii tih^ inniU :i;at ha. htMii provideu tu voil SumeUrn(>^. you inay 
havt' had to dn work thai should liavt' hv^u performed in previous Hteps. 



1 r IS IMIK)Rd ANT d'llAI' YOr KKl':ij THIS IXFOUMAI^ION HACK 
TO TlIK APPKOPRLVrK PKOFLK SO ^FlIAT HKVISIONH CAN HK 
MADH 'ID KI'KIsOT 1 M IMU) VKM KN'i !N d HK HNU PR()DU01\ 



In your resrarrh inr ihi. st.'p cd' [hv 1 nsf rurtiunal SyKKuuh liovejoprntMU proet^^iK 
you may havr diseovi^rnd additinnul inrornuitiun tliat y ui think may be useful 
to peopli^ who will hi' working in steps lhat foiluw tfijs one. If so, it is equally 
mif)orLant tluit you pass this infnrmatirm on to app)'opruile p(»ople. 



HKMKMIiKR, OOMMUXlCAddOX WITIIIN TllK INSTRUCndON 
SYSTKMS DHXTCROrMKNT PROC^KSS IS CM^IddCAR VOH 
KP KK(TI\d-: INS'PRrcndONAP DIA'PLOPMRN] 



^ A r.)p- ol [lu^ ('OOl^DlNATlns ,:M!d/[ r:v) \u U; : hr n;H-k of 

n^Muiai Mal;^' airn.'ient eopu-. -Miaidr ycu; [o i:d on- u. i'Vi^vy individua 
yr)U Wish |m rcmuuunH'att^ wuh- pPls .'opa Toi^ VoU»' ord- 



® C^unpii'it' dfp ISf) ^ "u? )U , >; X/ej {OX ^^lUj ; ai dup- 



Mio (Hi! eojn* t(^ 



v. 7 c 
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JOB AID FOR 
DEVELOPING TESTS 

USD !L2 

'IhiH !H ihi- C)[h 111 a sorioh of ISI) Jul. Aids for uso in nistriu'iiuiuil d«'Hik:n aivl 
di^vtMopintMU. This voluniu is lu lu* UM>d as a supplriiu'iu lo Liu* i)rimur\' duruniiuii, 
'Mtih Aids; Descriptive Authurinu Flowcharts ISf^ I L2 Developing d'ests." 'V\w 
Hinvrhart tkuainient sviU dirt'td you to spiH-ific cindaiuu', i-xaniples, and rtdViviu-i>s 
provicicd in this voiumc. If yuu do not havu ihi^ pnnian- riowchart df^funKMii. laujuost 
ii Ironi your supt^rvisor. 



The wording in this manual should not be construed to 
discriminatG between the lexes. lii arder to avoid a 
repotitious use of the terminology, ''he/she/' the terms, 
"he," "hinn," and *'his/' as well as '*men/' are intended 
to include both the masculine and feminine gender. Any 
exceptions to this usage will be so noted, 



o 

ERIC 




to bi(>Lk 3 



from IjiacK 2 



i- 



'lat U tlie Job kid ^OK "De.ve.top Te-i^ti'^ AM About? 

o GOAL 

u':r ^'Jtt'' " = " " P-Paration „f wntten 

t-.'.l- ' ''"^ Holuiers r„ correctly peribrm cTiticul tasks or 

task Ll.mt-nts. At prosent the job aid docs not cover the dovclopnient of hand,=on 
tests nor does i cover preparation of administrative materials or validation of ' 
t^«t aoms. Mu^h.of the information contained in this job aid has been taken 
Tp^ Guidelines for Development of Skill Qualification 

iMh US Army rraminB Support Center, Individual Tnimin g Evalu ation Direc- 

' itl^'T' d r ' f"' ^^^ ^^ aid deab lvSh 

by I, It can be used for developmg tests other than SQT. The user of this job 

;a;u:;^i^^;m^.;"^°^"^"^'"" 

« OBJECTIVES 

1) Given a list of critical tasks and the associated task analysis data and learning 
objoctivos, dntormine which tasks and task elements should be tested and the 
means oi testing. 

2) Giv^n the appropriate worksheets, document the tasks and task clement, to 
be tested and the m(-thod to i)o used for testing. 

3) Given the tasks and task ch-ments with the method to be used for testing 
each Klontincd, develop written tost items for those elements idoitified as 
being best suited for this method of testing. 



PRODUCT 



— 'rhis jul> aid will ri^siiit in the identification of taHka unci task clemenlH which 
nHjuirt^ the prc'paraii()n of test items and Ihe itientification of the most stiituiile 
iiiethod iur testin^l i.hom._ h'ov Lhc)se iusks or lask eienienLs lur whicii wriiien 
t('ht ilenis are jiid||iHl to be the most suitable testing mode, test iteni. will hv 
preparecb 



OVERVIEW OF MAJOR STEPS IN DEVELOPING TESTS 

Siep L Task analysis data and learning ohjecti%'es for all criticril tasks are examined 
to deterniine which tasks and task element requires test item .preparation, 

Ste{) 2. For task elements determined to require testing, the most appropriate- 
m Thod of testing (hands-on, |)erformance=certification, or written) 
is identifiefh 

Hte|) 3, For all task elements for which a written test item is judged to be the 
most suitable, the |irecise type of written item is identified (written^ 
ptTformantre or ptnTormanceMiuscd test item). 

Step 4. Writ ten-performance and performance-based test items are prepared, 
WORKSHEETS USED: 

— The Tables on pages and F-7 show a . ..mple of the completed Test Element 
Decision Sheet (TED) and Test Item Construction Sheet (TIC). 

DESCRIPTIVE FLOWCHART 

— The flowchart on pages R-51 thru F-53 shows the major stops in the use of the 
Job Aid for Developing. Tests, The flowchart will be useful to you in getting 

a clear picture of the overall process used in this job aid, A more completely 
described flowchart is provided in Job Aids: Descriptive Authoring Floweh^ts 
ISD IL2 Develop Tests, pages F^3 thru F44, 
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How Vo I VeX^iMLnt Diko^thz/i a Task Requ^w ^Tei^ng? 

« It may not be possible for you to test every task in the MOS or skill level you are 
working with. This will be especially true if the test you are preparing is an SQT 
where the number of scoreable units is limited. Therefore/you may need to deter- 
mine which critical tasks require test items to be developed, When making this 
determination keep in mind that the tasks included in the final test may inten- 
tionally not be a random sample of the critical tasks in the MOS, nor necessarily 
a representative sample of these tasks. The Tasks that you select should be 
selected in terms of the extent to which they need to be made the focus of training. 

• The following five major methods of task selection should be considered: 

(1) Known performance deficiencies 

(2) Critical combat systems 

(3) Army Training and Evaluation Programs (ARTEP) 

(4) Evaluation results 

(5) Job content 

— Known Performance Deficiencies . The purpose of this method is to select tasks 
that tend to be performed poorly by most soldiers in the MOS, If only one 
method of task selection could be used, it would most likely be this one. The 
difficulty with its use is in obtaining sufficient information on which to base 
judgments. Some of the more generalized sources that should be considered are: 

a. , TOE Manpower Authorisation Criteria (MACRIT). The US Army Devel- 

opment and Readiness Command maintains a ma.^ter data file of annual 
direct productive maintenance man-hour'; (AMMH) for all standard and 
limited procurement items of equipment, 

b. Equipment-Maintenance Related Reports and Data. 

c. Technical Proficiency Inspection (TPI) and Technical Standardization 
Inspections (TSI). 

d. IG Inspections 
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e. Panel of recent supervisors 

f. Panel of recent job incumbents 

g. Field Survey of supervisors and job incumbents 

^ Critical Co mbat Systems. Tasks chosen for testing may be selected on the basis 
of their contributions to the successful operation or maintenance of critical 
combat systems. Critical combat systems are equipment items or other opera- 
tions that are pivotal to a unites success in combat. To use this method of task 
selection, first identify the critical combat systems that are related to your MOS, 
and then identify individual tasks that are directly related to that system. 

ARTEP. The ARTEP, of course, describes unit tasks while your test is based 
on individual tasks. However, it may be useful for you to consider testing 
individual tasks that comprise unit tasks or minions in the ARTEP, Loolc for 
deficiencies in crew/unit performance that can be translated into individual 
tasks for use in your test, 

Evaluation Results. The Directorate of Evaluation (DOE) may have valuable 
data concerning performance deficiencies for many of the critical tasks. 

Job Content. Just as known performance deficiencies are the most desirable 
tool for task selection, sampling on the basis of Job content is probably the 
least desirable. If the expertise and experience available tdsyou is insufficient 
to enable you to make judgments as to degrees of criticality for testing, you 
will probably need to resort to Sampling from the critical task ''list. However, 
even here the sampling is not done on a simple random basis. Tasks should be 
organized into content or functional areas and a proportional sample drawn 
from each* 
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W^eAe Can I Ob^Un tko. Tut Etm^yit Ve.cJAl.on 
She.U iTEV SkteX]? 

• The Test Element Decision Sheet (TED) is available for duplication in the 
pocket at the back of this manuaL 

• To see a partially completed TED Sheet refer to page 
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VfLLonAXy ion Tuting? 

• If you used more than one method or source for task selection, you may at 
this pomt, have an unorganized list of tasks for test item development If that is 
so, sort the tasks, in a rough order of priority for testing. A major reason for 
this grouping is that you may have identified tasks- that you will want to test 
regardless of subsequent testing restrictions that you may encounter For example 
your supervisor may have specified tasks that must be tested. You would cer- 
tainly want to identify these tasks in some manner as have a high priority for ' 
testing. You may have other tasks that were identified by less reliable criteria 
which you may later consider dropping from the test if too many tasks have been 
selected for testing. 
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OAe. the. Th/ite, Compone.yU4 U6e,d Ion. Testing 

• In Skill Qualification Tests (SQT) there are three componants which comprise 
the SQT. Even though you may not be developing a SQT it will be useful for 
you to determine which of these three components is the most desirable and 
feasible method of testing the task element under consideration. The three 
components are as follows! 

~ Hands-On-Component (HOC). The HOC tests the soldier's ability to perform 
critical tasks or task elements on acitual job equipment or simulators, 

"~ Performance Certif ication Component fPCC) . Many tasks, or task elements 
may require the soldier to use manipulative or other motor skills, but these 
tasks and task elements cannot be included in the HOC because they are so 
expensive in terms of time, equipment, and other resources. For this reason 
If you are developing a SQT you may wish to consider the task element for PCC. 

- Written Component fWCi. The WC is a written test made up of scoreable 
units, with each scoreable unit comprising a critical task. The scoreable unit 
IS usually comprised of up to 10 questions (items), with each question having 
from 2 to 10 possible responses. The WC is used to test those tasks and task 
elements requiring decision-making or other mental abilities. 
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How do I Pe^eArridie Component ^ (j^klak tkz Ta&k 
Blm^nt Skould bz Mslgnzd? 

• Tasks and task elements are allocated to components on the basis of task content 
and testing feasibility. Both concepts assume that you know how the task ele- 
ment being considered is performed. This information can be obtained from a 
study of the task analysis data, 

— Task Content . This concept involves deciding on the type of task and the degree 
of skill required for the task element. The skill category to which the task 
element fits into should be available from output from ISD ILl Develop Objec- 
tives. After determining the skill category of the task element remember that 

all types and levels of skill can be tested validly in a hands-on mode, assuming 
unlimited resources . Some physical tasks may be tested in the WC, but highly 
skilled, physicartasks must be tested in the HOC or PCC. On the other hand, 
some mental task elements may need to be tested in the HOC, but mental tasks 
and task elements are usually more amenable to variations that permit written 
testing. 

Testing Feasibility, Any testing requires some resources, The^VC is. usually 
the least demanding because many soldiers can be tested on many tasks, or 
task elements, in a relatively short time with one test administrator. However, 
the support of some tasks may be unfeasible in the WC because of requirements 
for equipment, complete publications, etc. The HOC will always require equip- 
ment/ terrain and several qualified scorers. In addition, relatively few tasks in 
the HOC can be tested in a short time, The PCC was set up to accommodate 
^ tasks that are extrem'ely time consuming and that require special terrain, 

facilities, or expensive equipmrnt, 

• After studying the task element content and testing feasibility, assign the task 
element to one of the three components (HOC, PCC or WC). Remember the 
following when making the assignment: 

— If there are no parts of the task element that involve highly skilled physical, 
actions, th^ task element should be considered for the WC. 

— If the skill is almost entirely mental, the task element should be considered for the WC, 

— All highly skilled physical elements that can be tested feasibly in the HOC should 
be considered for allocation to this component. 
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£ do I Reco/Ld Compowejrf A44^gw£d to the. 
TcL&k Elmtntf 

• In Column 2, Section 11 of the TED Sheet , .,.>re are blanks for each of the three 
components. Place a check (/ ) in the appropriate blank. 
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OJkaX Im a WMAMm-?2/L%omancLt Tut Jtm and a 
PeA^omancQ.-B(Ue.d Tut Itm? 

• The WC utilizes two modes of testing: the written-performance mode aiid the 
performance-based mode. Each task element allocated to the WC is testable in 
one of these modes. 

= A written-performance test item measLires the examinee*s ability to actually per- 
form the task element. Examinees perform whatever steps are necessary to 
arrive at the task product, and then based upon this produfjt, select correct 
answers from the real -world alternatives presented. For ex,ample, a written- 
porformance item might require that the examinee compute the charge for a 
4.2-mortar round- Examinees would actually have to perform the task to be 
able to select the right answer from the alternatives, 

^ A performance-based test item measures the examinee *s ability to answer ques- 
tions about how he would perforrh the task element. For example, an examinee 
.might be asked Jo identify bef ore-operations maintenartce checks from a larger 
list of maiptenance checks. , 

• A good rule of thumb to use in distinguighing between written -performance and 
performance-based written items is to ask yourself, *'Does the item call for the 
soldier to perform the task or task element as he would perform it on the job, 

or does the item call for him to amwer questions about how he would perform it?' 



HoLC do I VodoAmtn^ ti tk^TaMk Elmtnt SkouZd be 
Tidiecf by a ^nMttmrPiAiomanat on. PeAiomanae.- 
Ba;6td Tut Itm? .\ 

t ® Stutiy the definitions above. Written performance testing should be used whenever 
; applicable. Use performance'based testing orjly after it has been determinod that 
written-porfurmance testing is not applicableV 
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ifJkeAe. Can I Obtain ttit Tut Jtm Coyut/iua.tLon 
ShzeX [TIC SfmeJ:]? 

© The Test Item Construction Sheet (TIC) is available for duplication in the pocket 
at the back of this manuaL 



To stie a completed TIC Sheet refer to page 
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EXAMPLE: 
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W/i^^t A/te ^t/i£ Recao}'i4 That SoldJ^eA^ VmqumMy Cannot 
pQA^om tlm TcL6k Etment? 

Thore are four main catugories of r^mom why a suldier may fail to perform a task 
or tusk element. They are: 

(1) Don't know WHERE to perform 

(2) Don't know WHEN to perform 

(3) Don't know WHAT the product is 

(4) Don't know HC3W to perform procedure 

o Dant K now WH ERE to Per form . The failure to perform some tasks may be due to 
the inability to locate certain objects. For example, a vehicle driver may fail to 
perform checks on preventive maintenance on the component of a vehicle hecause 
he does not know where that component is loc:ued, A mechanic may fail to zero 
a multimrter hecause he does not know the location of the correct adjustment 
scrcnv. 

© Don't Know WHEN to Perform Step. A major reason for failure to perform a task 
IS tharUiF^TcneFmay not know when in a sequence of activities the step should 
be purformed. For example, it is physically possible to remove the hand guards 
on the M16 rifle at almost any time during assomhly. However, there is a point 
in the sequence when this step should be performed if the soldier is to avoid 
damaging the weapon, 

@ D on't Know WHAT the Product is. Another reason for failure to correctly per- 
form a task or task element is that the individual may not know what the end 
result of the element or step should look like. For example, a clerk cannot type 
a correct address label unless ho knows how a proper address is formatted. A 
gunner cannot obtain a proper sight picture unless he recognizes the sight align- 
ment when he sees it. 
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Don'i Kiiow HOW to Perform Procndnt-P The final consideration for wh^' soldinrs 
cannot F^erform has to do with procedure;. Soldiers may know where and' when to 
perform a stop, and what the correct result is. but they may not know how to 
produce that result-that is, how to execute the stut). Procedural failures may 
result liecause the soldier simpily does not know what the prO(:edure is or because 
no lorgets it. For example, in preparing a LAW for firinfi, one of the steps is to ' 
extend the launcher tube. The soldier may know that the tuljc must be extended 
prior to firinK and whore the tube is located and what the LAW would look like 
with the tube exiended. But unlpss he know,5 how to extend th(> tube !h- cannot 
ricrtorm the task. 

Study oacli of the four reasons for failure to perform a task or ta.sk element 
Determine wluch reason best explains a failiu-e to perform tho task element you 
are preschtly considerinR, in the next block you will prepare a test item which 
will assure that a failure to perform the task element is identified throuch use of 
the test ilem. 
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How do I PeuGxop a TsAt Itm Wliiak WLtt Tlio^ous^i^ty 
Ta6fe Eimmt? 

m Basocl on tho clptuiiiTinatioii made in i\v.' prt'uccclinR block develop a tost item to 
test WHERE, WHEN, W1LV1\ or MOW lu perlorm the task element. Use the 
following guidelines. 



— Identify tlie Corruct Location. This is simply deciding what the right answer is. 
It may lie necessary to actiially view the equipment if the element is equipment^ 
oriented. Technical manuals may not have a clear picture or a clear description. 
Be alert for TiM which may be in error, 

= Can Ph otographs sh o w the Item and the Surrounding? It may be possible to 
' show locations by the use of photographs. In fact, clear photos approximate the 
job presentation closer than any other two<limensional means. If photos are not 
practical, consider other visual means such as drawings or schematics. Insure that 
the photo or drawing is properly keyed. 

"= Froducc Description of Location. If the surroundings of the component cannot be 
clearly and accurately illuitratod in a pictm^e or visual representation, then the 
location of the component should be described as clearly as possible. 

Write Question for Locati^om Develop a question which will thoroughly examine 
the reasons for failure to locate tiie component. For example, with a keyed pic- 
ture of a multimeter, the question might be: ^'Which letter in figure _ . - repre= 
sents the location of the zero adjusting screw?" Or if there is no illustration, the 
question might be: -^Which of the following best describes the location of the 
zero adjusting screw on the multimeter?'' 



Don't Know WHERE to Perform 
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■ ^^kHljloalW Alternatives. Consider the likely options which you would 
imd on the job. Select from or use these options (no more than nine since there 
should not he more than ten responses per question) as alternntives to the correct 
answer. The types of alternatives selected will vary, depending on whether the 
item uses visual or verbal information. Fur a given item, the number of alterna- 
tives selected is not important. It is important, however, that the altc natives 
are reasonable and realistic in tornis of errors that commonlv occur in the 
rml world. 
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Don^t Know W HEN to Perform 



Identify the C o rrect Step/Sequence. This means identifying the correct point in 
the sequenc't; for performing the step 

Write Question for Sequence , Develop a question that will thoroughly examine 
the reasons for failing to perlorm this step in sequence. The question might be 
phrased this way: '*Which of the following steps must be performed before , . 
or, -'Which of the following steps must not be performed until , . If the problem 
is one of soldiers perfomiing the step, but at the wrong point in the task, the step 
may be given either in the question or as one of the altemacives. But if the problem 
is one of soldiers leaving the step out, it would be better to offer it as an alterna- 
tive while referring to a preceding (or succeeding) step in the question. 

S elect Real World A lternatives^ Identify reasonable alternatives that the soldier 
would find on the job. Select alternatives with emphasis on those variations which 
include adjacent steps. Remember that the alternatives (plus the correct answers) 
are limited to 10 selections. 
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Don't Kno w WHAT the Product Is 



Iden tify t he Cor nv-L Product. The first step is to corrnrtly identify whut the 
correct outcome, result, or product of the step is. 

Is the A bih:ty to " Read" t he Product Needed? In deterniining whether or not the 
correct product has been obtained, an individual may be required to judtze or inter- 
pret diagrams, meter readings, aerial photographs, charts, position settings, or other 
similar visual representations. If these kinds of things are used in determining 
whether or not the step has been completed, then pictures or visual representations 
should be used in the test items, 

Pru i mre description of tlie Prod uct. If the product cannot bo represented by some 
visual means, it will be necessary to write out a description of the product. Insure 
that the description contains the discriminating cues that the soldier mentally 
uses on the job. For example, ''needle reading is in the green area'' or "the dial 
is rotated until the detent is engaged.'' 

Write Question for Product. Develop a question which will thoroughly examine 
the reasons for failing to produce (identify) the correct product. This question 
should center around the scope and basic content of what the correct product is. 
For oxample, '*Which of the following pictures shows the correct sight alignment 
tor the M16?" or, ''When conducting an operational check of the field telephone, 
the LOUD switch should be in which of the following positions?" 

Select Real World Alternatives. Identify all of the reasonable variations and eiTors 
w^hich could be expected to occur on the job. Select the alternatives from these 
common errors which would lead to failure to produce/identify the correct pro- 
duct. The alternatives selected should reflect the more critical errors if more than 



Don't Know HOW to Perform Procedure 



Identify t he Correct FrQCjeduro. As with all reasons for failure, the first ste[) is 
to identify the conect way to perform the element. 

Write Question fo r Procedure, Dovelop a question which will examine the reasons 
for failing to perform the procedure correctly. Several approaches are possible. 
The soldier may be asked to select correct steps from several presented, to place 
steps in sequence, or to judge a series of photographs as to their correctness. 

S elec t Real \y or Id Alternatives, Select the nine (or less) responses as alternatives 
that reOect the most likely incorrect actions that the soldier would take on the job. 
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W/i2A£ on tke, TIC Ske.&Xi .U tko. PeJt^oma.ncg~BcL6^d 
TzMt Item Re.aoKd£.d? 

Q The performance.based test Item that you have developed is recorded in Sec- 
tion II of the TIC Sheet. If there is any photographB, drawings, etc. associated 
with the test item, be certain that it (they) is attached to the TIC Sheet. 



IfJhcLt Coe6 the, TIC She.z.t Look Like, When the. 

EXAMPLE: 
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10 black 40 



Q Whtjther preparing a test item for an element or an entire task, you bcjgin devcN 
opment by describing the job situation. This description of the job Hituation may 
apply to several test items, or it may apply to only one item. In Example 1, 
below, a test situation is shown which applies to two questions concerned with 
computing measures of central tendency. 



EXAMPLE 1 



Situation: You are an instructor at the US Army Signal SchooL You have 
just completed the scoring of a test which resulted in the following scores. 
Your branch supervisor has instructed you to compute the mean and median. 



Soldier 

Alberta 

Wakelin 

Bracldoch 

Hey man 

Holmos 

Robinson 

Monday 

Poole 

Hermansen 

Crisler 

KincjMeese 



What is the mean? 



Test Score 

34 
35 
10 
45 
34 
30 
61 
67 
81 
10 
10 

2, What is the modian? 



A. 


39 


.A. 


44 




34 


B. 


45 


C. 


10 


C. 


30 


D. 


35 


D. 


47. 5 




81 


E, 


71 




67 




41.8 


G. 


38 


G. 


34 


h 


45 


H, 


35 


J, 


61 

41 J 


h 

J. 


34.5 
10 



1G2 



^ Thv test situation should provide much of the information nocessary to formulate 
the quostionrs) you are ^olng to ask. While all necessary information pertaining 
to task conditions and tho job setting must be included, avoid information that 
IS unnecessary to task, or task element performance since it consumes valuable 
testing time. 



If a test situation has not already been developed that applies to the task elciment 
you are r?reparing a test item for, use the information above to prepare a needed 
test situation. Jot the tost situation down on a [lieee of scrap paper for the 
present. You wilUater record it on the TIC Sheet. 
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HoiQ do I Peie^ticne l^: the. Job 5i^<jria£a6 Condltloiu 
MiMt fae Re^£ecied .die Tei^t ttejnf 

^ For some tasks, or task ulemonts, the job stimulus conditions may be tninslonl. 
That is, som.o things the soldier must obstnn'e, listen to, or otlierwise Hen.st' in 
a job setting may be present for onl^ a brief time. Examples are^-^ 

(1) A passing aircraft that must be identified, 

(2) A briefly exposed tank that must bo judged friendly or (mcMiiy, 

(3) An ineomJng radio niessage to be recorded. 

. @ It is important that you recogni/:e when such transient stimuli are pai't of the 
task c!onditions since it will make a difference in how you present the stimulus 
in the test item you are preparinfi. 

# Esamine the task element for which you are preparing the test item. Use the 
following guidelines when preparing the item: 

If the stimulus condition is transient, you must attempt to control its pircLsen- 
tation to the examinee by use of slides, videotape, or audio recorciings. 
Although the form of the stimulus will be simulation (a picture or recorded 
HOund), you can limit its c^xjiosure time to that which would occin" in the 
job situation. 

If the stimulus condition{s) is/are not transient, luit i^liivo relatively constant in 
the sense of being present for the soldier to react to or o|}erate on, then it/they 
should be presented in the test item or as a supplement to it, Tht^ stimulus 
can be presented as a narrative description, a picture or diagram, an actual 
doeiimf'nt, or a simulative device. Examples are= 

(1) Distance on a map - 25 kilometers 

(2) Range t(5 a target - 1500 meters 

(3) Eligibility for overseas levy - yes 

(4) Readiness status Of a piece of equipment - RED 

® Pr(*par<7coll(Hi. any needed slides, videotape, picture, diagram etc. 
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How do I Pn^^poAe. th^ ^LLQAt^on ok Stm? 

• Once you have specified the product of the task element, you can prepare a clear 
question to be asked or statement to be completed (stem). In testing a task ele^ 
ment, the question may have to be preceded by a further narrowing of the general 
test situation already prepared; that is, a specific situation. The specific situation 
and/or question should make it clear to the soldier just what he is to produce. 
Examples are= 

**After you return from point C your squad leader gives you a missbn to 
reconnoiter the bridge site at point CV Using the grid-magnetic angle shown 
below, what Is the magnetic azimuth you will be using?" 

— '-What is the ground distance from point A to grid coordinate EG 158858?" 

• Jot the question or stem down on a scrap of paper. You will record it on the 
TIC sheet in a later block, 
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Hou) do I VfiteAmine. the. MXeAnativu to, tkt 

• For most test Items there should be no more than 10 possible answers to the 
item (9 alternatives and the correct answer). Actually, for many items the num- 
ber of possible answers will be much fewer than 10. In any event, if your test 
item, is to be used ^in a test other than SQT tr^ to limit the number of possible 
answers to 10, If it will be used In SQT you must limit it to a maximum of 10 

^ since the SQT answer sheet provides for no more than 10 possible answers. 
; . ■ : ■ 

\ The first step in preparing alteniatives is to identify incorrect products that often 

result in reaUworld performance of the tapk or task element. These will be used 
as altematives to the conect answer in the multiple-choice question. There is not 
a certain number of alternatives that should be used in an item except for the 
limitation discussed above. The number of alternatives should be determined by 
the number of different errors that commonly occur in the real world. Do not 
simply generate altiernatives mechanically, but check to make sure they are reas- 
onable options. For example, in measuring the distance along a route on a map, 
the straight iinje distance (ignoring curves in the route) would be one common 
error leading to an incorrect product. Using the scale of miles, rather than meters, 
in converting the measurement to meters might be another common error to 
use in identifying an incorrect answer alternative. In the rare instance where more 
than nine common errors occur on the Job, you should reduce them to nine nt 
fewer on the basis either of how frequently each occujs in the real world or how 
critical each error Is. 

. A / ^ ■ ■ 

• Jot your answer Alternative down on a scrap piece of paper, Thay will be recorded 
in a later block. 
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Hot<; do I VoXeA^nine. Too^lM, Job A^id, on. 

• If tools, job aids, or references are necessary or considered acceptable in f)er= 
forming the task, they should be made available on the test. You should con- 
sider the possibility of using a simulation of the tool or aid if it is not feasible 

to provide the actual one. If being able to locate information in a set of references 
was previously identified as an essential element, the manuals or references should 
be provided. Jf it is not feasible to provide the actual references, extracts of the 
material should be provided to permit an evaluation of that portion of the essen- 
tial element dealing with the interpretation and use of the information. Exam- 
ples are= 

(1) Protractor, compass for map-using. 

(2) TM or extracts from TM. ; 

• Some cautions are necessary when considering references. 

= It is seldom possible to provide each examinee with a copy of a particular TM 
or other reference. The most feasible method of providing references is through 
use of extracts. If you are developing an SQT, a maximum of 30 pages of 
extracts per test can be printed unless justification for an exception is obtained 
from ITED. 

= Limit reference extracts to situations where the ability or necessity to use the 
information is the critical element. 

— References cannot be provided for every test item, nor is a reference needed 
just because it exists. You must consider the job requirements. For t xample, 
the procedure for clearing a misfired round is contained in the TM, yet t e soldier 
does not refer to the TM when a misfire occurs. You must decide what 
material the soldier in the MOS and^ skill level is expected to know. 

= Do not discard the idea of a reference just because some soldiers in the MO% 
(usually ''experts'*) can perform the task without use of a reference. This 
could lead to claims of ''four* on the part of less-skilled examinees who feel 
they have been discriminated against by the lack of references which are 
authorized and routinely used (by them^ anyway) on the job. 



F-40 



^ Some references published by cortimercial industry, developers, or oven individual 
authors are copyrighted. Section IV, chapter 1, AR310-1 specifies the proceduix* 
for dealing with copyrighted matorial and how to obtain clearance for use. 

If you determine that tools, job aids^ or references are needed for using the test 
item, make provision for obtaining them. 
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HoiA) do I Reco/Ld Twi I^e^ an thz TIC S^eei? 

• In blocks 39 thru 43 of this job aid you have collected scraps of paper 
and collected needed tools, aids and references. In this block you will 
incorporate this material into a test item which will adequately test the 
oxaminee*s ability to perform the task element, Prior to the actual record- 
ing of the test item on the TIC Sheet make one final draft in which you 
incorporate the test situation, test question or stem, answer alternatives^ and 
any needed references, aids or tools. Review the draft item to be certain 
that all parts of the item communicates to the examinee, Be concerned 
with the following: 

=- In some of the more technical areas, there is a tendency to t^ to sim- 
plify technical items during the development of items. When this Is done, 
however, the item may lose its intended meaning. Technical terms used 
on the job by the examinee have very precise memiings. If they are used 
routinely on the job, they probably should not be changed or ■■simplified" 
for the test, All test material should be written in the normal Job Ian' 
guaga and reviewed and revised until they pass this checkpoint. 

= Is the test item independent of other test items? Check to be certain 
that the stem for one item does not give away the answer to another 
item. An examinee who reads the stem to an item should not be able to 
work backwards and correct a previous answer. 

• After you have prepared the draft test situation, question, alternatives, etc. 
and have reviewed them for adequacy, record the test item in Section 11 of 
the TIC Sheet. 
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• Dufifiq Ihf pftjcn* ifi dgveinpiiiQ M>%\ Wem 
tiitDfiiUiiOn mj^ have btitu ubUtMed Ihjl wrMitij 
he iiu'tul lu fie'lQiii vAm pnUjUmi mi'tmi 
ilig] Irrt Ifliti ihii Lluti SimiliHlv. inJittiii,5l!iifi 
may hive tiecfi lihiJifierJ ihai Auuld bti uu-lii! (u 
Qt-iiuni «hu Will he engagctj tn Ifiiifucliunjl 
Syiiffiii Dtyslormie"! iUpi l'»j' ''-''""-'^ Ihii unt. 



Ctjtiinii'n f I aie jy«:uMieiJ 3ftil iiibniiuej hi 
iiPprupMril^ pEiiuni. 



W/i^ U tko, JjnponM.me, oi pmpa/Uvig comme,yiU ion. pe,ople, 
mn,klng In otk&A ^te,p^ oi the. MtmcMonat ly^tom 
dosJoZoprntnt pKociuAl How do I n.e.cjon,d tkm? 

• In order for the Instructional Systems Development process to work effectively 
it is imperative that there be forward and backvyard communication between the 
people involved in the process? .At some time or other you have probably com- 
plained about the input that has been provided to you. Sometimes, you may have 
had to do work that should have been performed in previous steps. 



IT IS IMPORTANT 'THAT YOU FEED THIS INFORMATION BACK 
TO THE APPROPRIATE PEOPLE SO THAT REVISIONS CAN BE 
MADE TO EFFECT IMPROVEMENT IN THE END PRODUCT, 



In your research for this step of the Instructional Systems Development process 
you may have discovered additional information that you think may be useful 
to people who will be working in steps that follow this one. If so, it is equally 
important that you pass this information on to appropriate people. 



REMEMBER, COMMUNICATION WITHIN THE INSTRUCTIONAL 
SYSTEMS DEVELOPMENT PROCESS IS CRITICAL FOR EFFEC- 
TIVE INSTRUCTIONAL DEVELOPMENT FOR SUCCESSFUL 
MISSION ACCOMPLISHMENT. 
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^ t ISD COORDINATION SHEET cnn be found in the back of this 

manual Make sufficient copies to enable you -to send one to every individual 
you wish to communicate with=plus copies for yqur records. / 

• f;°"^P'"te the ISD COORDINATION SHEET in duplicate. Send one copy to 
(IRslSsf ' ' *- Instruction Settings Selection Package 
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JOB AID FOR 
DESCRIBING ENTRY BEHAVIOR 

iSD I). 3 

Manuaf 



I his IS thv ah in a .vnvr. of ISI) Job Aids fur uso in instrucaional th^^im and 
di'vH()pmrnL IhiH vulume is to \w usod as a supphmKMit to the primary dorumont 
. ui) Aicls; DPHcTiptiVi* Autnunn^ FlowchartH IHI) 11.3 DrHchiH^ l^ntty iMiavior ' 

■^^Y'^^''''^' '^''^'''''-'^'^'^ '''^^^ ^'-'^^^'^ ^''^'^ sp.H'ifu^ t^UKlaiHHs I'xaniples, and rplVrcMic^^s 
pruvidtHl HI this vulu^u^ If you do not have the prima y flnwehart ciot:umc>nt request 
It Irnni your sufUTviHor. - - i 



The wording in this manual should not be TOnstrupd to 
diicriminate between the sexes. In order to avoid a 
repotitfous use of the terminology, "he/shy," the terms, 
"he/' "him," and "his/' as well as "men/* are intended 
to include both the maseuline and feminine gender. Any 
exceptions to this usage will be so noted* 
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iiJiiat l6 tlie ViUCL^bt EnMy B^kav.io/i Jab Aid M abotU? 

o GOAL 

Vnur iiiuil m iisinu this jol) aid is tu iust ihv untry behavior of traineos and to 
uiiiizr thi^ intbrmation in Lhr following way: 

to [\i\juM {\w ^ir^jnl:il!^ point of inslruetinnai uidts 

to vprify (ir revise th(^ asHumptionh made in the learning analysis perlbrnied 
ISIJ 11.1, Di^veiop Ohjeetivc^s, a!)oiil entry skills and knowlf^d^os of trainoeH. 



o OBJECTIVES 

I- (Hven a irarnin^ analysis (output of ISO IM i to idiMitifA" and reeord for each 
task ihf Inllowifi^ information: 

Initial breakdown of tht^ task intC) broad sul jcntlinati' task elements. 
( bevel 1 and 2 Task KlenuMUs) 

■ Hrtsikdtjwn ()f the task into th(> most d(4ail(Ml sub-innate task (>lement for 
whieb traiiiinu is re(|uir(^(b (BASK: ^Fask Klemen;^) 

2. Having identdled and reeord(Hi all liASIC Task Kli'mtMitH, to validate the* 
BASIC Task Kl.-nHuUs for eai^h task to assun^ thai tlu^ huuMim^ analysis 
}H4lornit>d ..i IS!) II ! was ncMthcT earried out m too mueh dtTail nor too liit.h 
dtMaib aiid to modify i he learniuu analysis as niMU-^sary. 



© PRODUCTS 

This job aid will resuk in 

- a eonipkned Learning Analysis Validation HhiH't 
a validated learning analyHis for each task 
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o r/iAJOR STEPS IN PROCESS 



Step L Vi'ii minv and vuronl tlic^ iii|ih^^sl levi4 Lusk t^UMmMits ( f^eviO 1) in the 

Sti^p 2. Di^ormine aiui rct'orcl the* st'coiui hlHlu'sL level L:isk elenients (Level 3) 
ill Lhi' icarninii aiKUysis. 

8tc*p IL Jeterniiiie anil I'eenrLl tlu* lowt^ : level, task I'leiiients for whieh training 
;s rtH|uirc'cl fI>A8IC I'ask Klenients) in ihc^ huirning analysis. 

Hl(*p 4. Uc^vclop, atifniiiist rr scorc^ HAHlt' l ask I^leniinit Test, 

Ktt*p Dt4(Maiiine eritt^ria for MORK or LKHS (h*taih'ci anaiysis of 
Task KlenitMits. 

Ktt^p On tilt* basis ai' the (Materia rcH*f)rcUHl ancl tc'St seon^s from iht* F^A8I(' 
Task Klement 'I'est, cleterniine if any BASIC Task KlcMiient needs 
MOIIK ()r LKHH detailed analysis. 

St<*p 7. Witii the assistancie of the persoii who did the' orii^inal learning unalynis 
in IriU ILl, cieLerniine if additiona; analysis is frasible; and if so, 
perform the* additional analynis, 

Stup H. Report any tdiaiiges In the original learning aiuilysis to all piTsons \vhns(^ 
IS!) (aitfMit will bi^ aflec't(>d. 

e WORKSHEETS USED 

--- On pa^c' (i=5 is an exaniph* of a ef)niphMt:d 1 earning Analysis Validation 
Hh(>et (LAV Hh*>pt). 

© DESCRiPTIVE FLOWCHART 

Till' flowMdiart on pages 0-5 1 thru ti = 5f) shows thf steps in using the Deseribe 
Kiitry Hehavinr Job AicL The flowehart will be usefiil in gc^tting a elear 
pieturi* n( ihi' ovt'rall pnx'ess usiul in this^job aid. A nior^ conipletely 
(h^scTibed flfuvcdiart is provided in f]o\) Aids; DescTiptive Authoring Flow- 
rharts, pu\i*'H thru CM 2. 
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iSD il 3 Doscribe Entry Bt^hrtvior 

LEARNING ANALYSIS VALIDATION SHEET 

(LAV tt^^V 
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- JIB - / 


■■ 3'iQ-S7S= /QDB 




















70. 






















1 , 

I 


' : 








^ .. ,.i ... 
























a- 

/fV/fr uj^r^ 










A.J 












^.^ 













B.J 






3^ 






A 
mi/c 




BO 










SO 




/I J. / A / 


ms/c 




50 




/h J /. J / 




3D 








13 


30 




. _ i 




■ i 









1 or- 

G.6 



•■ ' urn {ilucKu 4 ^fif I b 




G.7 

13G ; 

o 

ERIC 



ff urn iilucr G ami 1 
A. 
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\u hinfrk 1 1 



W/iete can I obtcilyi a L^aAning AnaZy6^U yaZidcUAjOn (LAI/] Slite^t? 

^ I>A\' Sli -Ms nr<^ a\^[ul '^b* for fiiiplii'it' '-mi in tht* IsiifM^ ptjrkfi (^f tfii^ ni:ini!:!l. 
^ lo set* an cxanipli' of a romphMtHl LAX" SIuhM, n to pa^i» 
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EXAMPLE; 



rsn II 3 Dp.cnh; Entry B..h.v.or 

LEARNING ANMYSIS VALIDAT!ON SHEET 
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^ ISD II 3 DoNcribe Entry Beh^vigr 

LEARNING ANALYSIS VALIOATiON SHEET 
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In ISl) HI. 2 a .l.-nsinn will h.. niiul.. a. u, how ..ad, task will In. inn.u.d i v 



.""'■'■«^^>'T t» Hl.nn.fy tlu),. task demPnis and thnr n..nnntM,l l.,.;^ip., 

^ri>n nH'h';i ,T"'' ">''!'; ^"'f '^''"^■^ "-'l^-'r^' trai.un,. Tins uLnUncatiun wni'h.:'^ 
; • - ' ''nn:uh .h- ad.n.msm.fon nf a p,vt,.l wh,.h .unsists of t..t u.ms lor 
ufMH I..U.I task d,.mpnt., In this hlnrk you will id,ntiry Lewi 1 Task Kk^ment.. 

HoLV do 1 Ideyvtl^y UvdZ 1 Tcuk EldnmiU? 

fn ilu. Iramin- analysis don,, in IS[) 1|,1, Devdon ()l>j,...f v-s the ta^k si-,l..m,.n- ,„ I 
.a^< H,.jn.us shotdd hav. h,.,. amtn^.d ,n a mcHUIT.d pyramid f^n!" U t 'l' r ; [ l' 

.lulb, and kn<>w|..d,..s. An .xamph. of a mociUuHl Larnm, pyramid ,s pv.n on th. 
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Lt/val 1 Tasl; tlvmunu 



Hihi iViTH PACi? 



MATCH SrMfiaL:^ 

in ^CTifAt 
f f M M A I N 



N f It Y 
StMRlU S 



CL5L0PS 



ItJENTIj- y 
S?fAPFS 



fl i I ! K f n y 











A ? i 1 i 1 





AIM ; -iUL! A 
f OH Ht Afiifin 



HAtiMAKi 
MAH|!\F. 



n F10 



In this oxamplu, 'ticH from piiint A Id W in the* Uink HtaUmicnt, Just Ih'Iow thp tank 
8tait»ment arc* the [.ovol 1 Task Hknin^nts: ^'OricMit map ancl vomymm'' and 'ilikn with 
pack", ^rhcso are Mip first Irvel skills or knowh^d^rs a pcrsun must pnssc»ss iH^fnrp he can 
porform tlu' task statomtMU. 

If you have a loarnintf pyramid availabh^ to you, you can identify Ww Lovnl 1 
TaHk Kh*m(Mits in your Umrnirm anrilysis by notina thuir position in thc^ pyramid. Thny 

diroutiy below the task statement. If you havi* no learning pyramid, you should have 
some means of ranking \\w task elements and their assoeiated skills anci knowled^^e. 



ID 

- J. \J 



If you used the HumilRO 4Db Aid for ISD II. 1, Develop Objectives, you will have a 
letter or a letter/nuniber eomhinarioii to identify eiieli tcisk element in the pyramid. An 
exuniple of the identifieation system is given below. 

EXAMPLE: 



AND 



MfRE ttlTH F*£S 



MAP 



MATCH SYMJiaLS 
TO ACtiiAL 
TERHAIN 



SYSTEM 



MATCH SVMBQlS 
TO Lf nt'iO 



HF M! COMPASS 



HFAQ CUMPA-SS 
VALULS ^ MUM 



SiGM I 



c - o 



CnMPASS 



ALinN F'DlfiTS 



AVQin MAGNf TIC 
ATTflACTfONS 



SprNTIf Y 
SYM80LS 



RFAH VALUES 
^iTH 
iNTEMFC! ATlOS 



APPLY nijLF::. 

F n R ^^ c a G 



TQ SYMT'LiFf THi! 
EXAMPlf THi r^i 
iTFMS HAV 
UMilUQ 



iOENTlf T 
COLpHS 



I (1 r N T f F T 
SHAPES 



inFNTiEv 

r.nAnuATin^ 

MARKS 



lUENTlFV 
^ERQ 
HE_f FRtNCE 
PQlNT 



I ii E N T i F ¥ 



in this example, Level 1 Task Elements ean be easily distinguished heeuase they are 
identified vvith a letter: **Orient map and eompass'' is A, and ''Hike with pack" is B, 
If there were more Level 1 Task Elements, they would hav^^ the letters D, K, utc. 

it is unimportant if you have used another system of identii .cation, so long as you 
can determine and record the task element levels. If you did not use a lutter/number system 
to identify the various levels of elements in your leaiming pyramid, you can adopt the 
system illustrated in the example. 

If there are no Level 1 Task Elements in the learning analysis, coordinate with the 
person who performed the learning analysis in ISD I LI, or the f)erson who developed 
the critical task list in ISD L3. A properly defined task should be capable of being liroken 
down into at least Level 1 Task Elements. 



How do L xtcoxd tlu Ldve^t l Tciik ElejmiiU on tliP LAU 
5/ieei? 

\uu'ii yuu haw- iucaicu .tii iiu' i,fVt/i i la^K ;Cii'inciU« \n your h-aniiii^ ani\iy-.i>. 
rocord the t>lcnU'nt aiitl its iiJontificaiioti iiuinlu'r or luttfr ;ninihrn- t)n tlu' tilvjci 
Column A. !:i C\>!is:ii:i 15. reoiMx! a 1 afUT all -.hv fir;:; k \ oU'iiii lU^.. 

iOlmt tilt LAU SkeeX Look UU a^ta^t tkd Level 1 
icL6k Etojimiti oAe XdcoKdedf 



EXAMPLE: 



LEARNING ANALYSIS VALIOATION SHEET 



LAV Sh-n 







jLd.. ' . 


















'Al 


1 




If seir^pat^etl instruction is tlet iTinineti to bu thu bent nioclo for Irainini: this task, 
\a'\\^\ 2 Task ^^Irments will also In* liuiudtHi in the pretest. Idtally, it would be dt^Hirai)le 
U) inelude in the firetest, test iit^ms mr all task e?i*ment ievt^s. Hut beeau of praetical 
eonstraints, we reeomniend ihat the pretest include test items for only Level 1 anil 
Level 2 'I'ask Elements. 



Hoi^j do J Idz^itl^y leuel 2 Tcuk tlmuvU? 

The mtnJiucis for locating Level 2 Task E- '^='onts are similar to those explained in the 
prc^vious bk;ck. Level 2 elements can be identifieci by their position within 1h(^ hmrnlnt^ 
pyramid and by the letter/number system. (See example on next pn^ej 
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Task Eiiments 




^ 10 iVMPLtf ¥ THi:, 
EXAMPLE THESE 
(TIMS HAVE MiH 
QMITTIP 



in the uxamplu ahuv(\ the Level 2 'rask Elomonts have \mm identified by usin^ the 
letter of the approf)riute level 1 element and a numl)er. Thus, ''Interpret Map/* which is 
a suh^'lement of A, "Orient Map and Compass/' (Level 1 elemimt) is identified as A.l. 
'rhe otliur Huh^'lement, 'HJse Compass," is identified as A, 2. Were there more sub-elements 
of A, tht^y would idf^itifiod ns A. 3, A, 4, A. 5, etc. The sub^elements under B, "Hike 
with rnek/' would be identified as lil, 112, B,3, etc. 

If you did not use a letter/number system to identify the varlous elements in your 
learning pyramid you ran adcjpt the system illustratGd in the exainple. 

It is possible that 3/our leairnlng analysis will contain ng Level 2 Task Elements. 

How do I mao/id tlie. Leuel 2 Ta6k Etmmti? 

® Wh(?n you have located all the Level 2 Task Elements in your learning analysis, 
rc'eord tht? eh men t and its irientiflcation number or letter/number on the LAV 
Hhcel, Column A. In C/olumn B, record a 2 after all the second level elements, 

« if there are no Levc^l 2 Task Elements, record '*NO 2'- in Column B. 



Mlm dou ,-t/ie LAU SkteX look Uk<> Htvt tii^ Uvel 2 



!SD If 3 D,,5.;,,bP Entfv Bnh.ivier 

LEARNING ANALYSIS ¥,UIDATION SHEET 




o 

ERIC 



irom block 16 



to i)iocK 18 



l)JhaX l6 a BASIC Ta^k Blmmt? 



s BASIC Task Elements are dcfineci as heina the re^^ult of the breakdown of a task 
into ite most subordinate elennients (or skills and knowU^dges) tc^r, whic h training 
in required, 

© BASIC Task Elements were identified in ISD ILl, Develop Objectiveri, as a result 
of preparing learning analysiB pyramids. Learning Objectives shoukl be available 
for BASIC Task Elements as a product of ISD 11,1, 

© The following are assumptions concerning BASIC Task Elements: 
= Training is required for a\j BASIC Task Elements, 

^ A majority of entering students tested on the test items derived fiom F^ASIC 
Task Elements will fail them. 

" Any suljordinate elements resulting from further breakdown of a BASIC Task 
Element do iio^ require training. 



o You will later use BASJ'.' Task Elements ior two puri.jnses: 

— To deiermine if the learning analysis performed in ISD IM, Develop Objectives^ 



To iduntiry test ilcras to l)e included in a pretest fur use in group-puced instructiuii. 

© Dnternuri^jneaniing In ISD II T, Develop 

OLyjectivos, certain asiuniptions were made about entry level skills and knowledges 
of the trainee. These assumptlans are important because they determined how far 
the learning analysis was continued. Each task was broken down to the point where 
it was assumed that most prospective trainees had .the prerequisite skills and 
knowledges for performing the task. 

Since the assumptions about entry level skills and knowledges are the basis for 
instrurtional development they must be validated. The validation will assure that the 
basic entry level of the trainee is coiTcctly reflected in the BASIC Task Elements 
previously defined in ISD II. 1, For exumijle, if you find that all entering trainees 



Why ^hoLild I Ide^^Uliy BASIC Toife Blm^yiZi? 



is valid. 




ran rasily nerlurm thf aclivity rclaiod to oiie or niori. BASIC Task Elements t|u>n 
tilt' Icarnini; nnnlysis for a imrticular task was carried out too far_ If this is tlu> 
case, llu- liuirninfi analysis for this task will nwd to bo re=exnminod and possibly less 
subordinate BAHIC- Task Klonumts identificHl. On tho other hand, it ,s also possible 
that the learning analysis of a task was not earried out far enough as onl" 



' -..v^v4HiJi, ii-T HITIhli 

rHTeentuKe ol entennp trainees (^an answer or perionn test items relating to BASK' 
.ask h.ernents. In this ease tiie iearning analysis may need to bo ro=examined to 
d.-termine if more sui)ordinato BASIC Task Klomonts need to be identified, 

Ulontify test jtems to be included in a prettwt jor use in groun-paced instruetion 
After the learning analysis for each task has been validated, test items for all 
BASIC Task Elemonts wili Ijo assemblod and incorproated into a tost In ISD 111 '? 
Specify Instruetion Managemont Plan and Delivery System, a decision will l>e made' 
as to what IS the most erfectivo delivery system for providing instruction for tl,e 
task. If It IS determined that group-paced instruction is the most offoetive the test 
Hems for BASIC Task Elements will i,n used to pretest students to determine if ' 
tlie class as a whole can bypass instruction for one or more of the BASIC Task 
Elements. 



How do I IdmtLiy and mco/id BASIC Tcusk ElQjm^iU? 

• Identification of BASIC Task Elements, 

~ BASIC Task Elements were iduntifiwl in ISD II. 1, Develop Ohjeetives You can 
determme which task elements are BASIC Task Elements by examining the 
modified iGorning analysis pyramids or Learning Objcctive.s Donumentation 
Sheet prepared in ISD 11,1, ^ 

- In the examplo on the next page, the BASIC Task Elements have been shaded 
to make thorn more easily identifiable (e.g., Identify Symbols, Identify 
Graduation Marks, Identify Zero b forunce Point, otu.) In the figure notice 
JT^h/'r JlrJ^n* '°'V?"^P°s«« °f illustration we have shown "Idontify Symbols" 
as the BASIC lask Element rather than "Identify Colors" and "Identify Shanes" 
l ie rea.son for doing .so i.s that we made the assumption (in ISD II 1 Develop ' 
Objectives) that entering students would already be able to idontify c'olors 
and shapes; tliereforo these task eloment.s require no training and are not 
classified as BASIC Task Elements. On-the other hand, it was assumed that, 
entermg students would ^ already know how to identify symbols This 



Q.23 



201 



EXAMPLE: 




p J 

! MATCH yfja^;. I 



SYMBOLS 



I AiTN 



IflFNTlFr 



ii!MS HAVE fa£f h 



mc.,ns that the block "IcionUfy Symbols" is tho most detail.cl task clom^-nt 

nrd fp^rr r'! 1"""'" '''"'^'^ '■"'^'"''^^1^ thus u i« HaKsi- 

1 1 t-ci a.^ a 15 A s i L i ask h\ v m u n t , 

- A Loarning Objoetivo vvoukl have hoen proimrod for the task ch-ment "Id.nt.fy 
hymbols. I.oarn.ng Objectives for tho elements "Identi^. Colors"' and " 

tr;S;/'"';i^!f, '^^^^ ^^Udents will not receive 

iraining lor ihohe tank elcmerUs, 

- Exumine oach branch of the lenrninK analysis pyramid to b<. certain that vou 
have Kienfified M BASIC Ta.k Elemant. assocuued with the task: 

- Aft^r yot. hav. identified ail BASIC Task Elements for a task, check to see if 

c e „ a Leammg Objective for each of these elements. If not, chances are ^nod 
U.at you have mcorrectly identified one or more BASIC Task Eiements 

^^ir^Il^ ''"'"'"8 '^^^ Elements is required 

an<i therefore LearninB C!,jectives should have been prepared. 

Recording Basic Task Elementj in Section V of the LAV Sheet 

~ Record each BASIC Task Element and the assodntodjdon^ m,mber in Col A 
- Record "BASIC", in Col. B„ after each BASIC Task Elament. 

" Tas^^l^r^^n ^f"" T-k Eloment may be classified as a Level 2 (or even Level 
lasK Elument. In such ca.ses record both the Level number and "BASIC." 
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W/ia^ 'dou tke. LAU S/iee-t look tike. a^toA I havz 
KQ.C£)h.dQ.d the. BASIC Taak ElmmU? 



EXAMPLE; 



ISD 113 DsiciibB Entty Bfhjvior 

iihmm huim validation sheet 



(Lav Shest) 



■■ — AfZ. Memf-^ d TO -^- 



fi.^ I J i ^ 




n.iWsHffO in* M,^ ifjM) 
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^ U ti 



from block 17 



to block 19 



2 Q*^ 



G.2S 



from block 18 




GuitknCt fur 



ZJ 

to block 21 



□utpuf fiurn iSp II |_ atvfigp Tei!i, 

If they iii fipt ivjilgble, fequRf them (?om 
IhB pifidFi fKpgftiifeli fgf dnflgpfng }HI ijimi 
Whin si'idiif i1 is{ ijEmi hsvi bten gbtiinia, 
fHurri tD Dtigfipuvi Agihfifmg FluMhifj. 
M 3, Block Ii 



from blocks 19 and 20 



iASlC Ttok Eiimifiii Thi (ill mi¥ bi I «Tiiiifl t«i. i pfftermiMi 
teji, uf i £om6init!Ofi q! thi ttfS 
ft Foi lufihir inl9imii!Qn= 



to bloek 22 



How do I pmpoAz the. BASIC To^fe Etejnen^t Tutl 

The BASIC Task Element Test should include all the test items for BASIC Task Elements 
It may be a written test, a performance test, or a combination of the two. It will later be 
used to determine if the£ASIC Task Elements have been correctly identified, i.e., that the 
learning analysis was carried out correctly. 

Test instructions should be written out, and the following information should be 
included: 

Purpose of the test. 

Testing conditions to be used. 

Scoring procedures to be used. 

Time limits, if any, for test administration, 

Etc. 

For more information, see Job Aid for ISD II.2. Develop Tests, and Swez^ 
GuiHehook for Developing Crlte rion^Referenced Tests, U.S. Army; Research Institute for the 
Behavioral and SociarSciences, August 1975. 
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from block 21 



fer.ffy Lhrt Siudftiii 



• For fufjhgf jfijafmiirfln, m bfla* 



to block 33 



Why do 



Since you are testing entry behavior, you must be certain f 
IS representative of this group The samn p%hnMH T',''^™'" '^at your sample population 
received training in the Ssk(s) blh^ S2 ft'^' ""'"^ ^'^^ ^''^^'^y 

renect the diversity of ani ^l^^SS^^el^SglSn^^^^^'^ 

^pla °' P^^*"^ «^«q-«'y 



G.ji 



from biock 22 




Adminittei lAKC 
tiik Eltmtnl 
TMi/CutTini!i Scgrn 



to block 24 



HoiA) do I admlYiUteJi the. BASIC Tcwfe EZmtyit Tut? 

When administering the test, be sure that your instructions are clear, consistent and 
comprehensive. Also be sure that testing conditions are the same as they will be for the 
students who will eventually receive training. 

More information about test administration is given in R.W. Swezey, Guidebook for 
D eveloping Criterion-Referenced Tests , U.S. Army: Research Institute for the Behavioral 
and Social Sciences', August 1975. 

HouQ do I eomp^e the. 4eo^e6 io^ the. BASIC Task 
Elejfmyit Tut? . 

In compiling the scores for the BASIC Level Task Element Test, determine the 
following for each test item: 

© The total number of individuals to whom the test item was administered, 
. • The total number of individuals who failed the test item, 

• o The percentage of individuals who failed the test item. (To figure the percentage^ 
find the number of people who failed and divide it by the total number ui 
individuals to whom the test item was administered,) 



from blQcN 23 

Sclgti F.Fii/Pjss! 
P*fi(s!t¥ Cernplsiey 
l^V ShHi 



lJmf<\\ He^iifJ \ Failing 
Coffeipt/ndi/ig Tiir luni 

Ci5ii c & rr LAV yiurH 



I 'yriher iMi\nni\,uis, ice LibIim 



to blot*H 26 



Whit dou ite LAI/ Stect look Ukt aiUK thz p^ont 
iaUXna and iko iamplz ^Iz^ ^.e been ^e^^^d? 













J 










f 
















\ 


A / / 






J. I i. J 
















J. /. /. J / 














40 




t 













3o 



3o 



30 



Jo 



10 



s 



C-30 



from block 26 



-4- 



DilEtmml.'RiCDfd 
Cnrtr-diBr MORE/LESS 



r 



to block 27 



dtiifmiMing if ihf leiFiiiMi jtiiiyvi iaf j fjU ifiyuld mcluile muff q 
l^y, !ubijrdm4.P talk itimfn!; 



deMM^d ItaJmlviQ anatys4A*^? 

In ISD ILl, Develop Objectives, a learning analysis was performed for each task and 
BASIC Task Elements were identified. (Remember, BASIC Task Elements are defined as 
the most subordinate element of a task for which training is required.) Identifibation of 
the BASIC Task Elements was made on the basis of the subject matter expertise of the 
individual who performed the learning analysis. One purpose of this job aid is to determine 
if the learning analysis is correct or if a more or less detailed analysis should be con- 
sidered. For example consider the following two situations: 



Si tuation 1 : AH entry'type students who were administered the test 
item for a BASIC Task Element failed the item (i.e., 
100% failed) 



Situation 2 : All entry^ype students who were administered the test 
item for a BASIC Task Element passed the item (i.e., 
0% failed) 



• In Situation 1 you should certainly consider performing a MORE detailed- learning 
- ajialysis. You have no assurance that the task was broken down into sufficient 

detail Further breakdown might result in identification of additional subordinate 
task elements wliich require training . i 

• Tn' Situation 2 you should certainly consider performing a LESS detailed learning 
analysis. It would appear that this task element had been incorrectly identified 
as a BASIC Task Element inasmuch as it is already known by our representative 
entry-type students. Tharefore, a LESS detailed subordinate task element should 
perhaps be identified as the BASIC Task Element. 

In the two situations above it was easy to decide that MORE detailed learning 
analysis should be considered tor Situation 1 and LESS detailed analysis be considered 
for Situation 2. However, these are artificial situations. Would you consider performing 
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a MORE detailed learning analysis if 90% of the entry^ype students failed the test item? 
What about 80%? Similarly, would you consider performing a LESS detailed leaming 
analysis if 10% of the entry^type students failed the test item? What about 20%? In this 
block you will establish the criteria to use in determining if a MORE or LESS detailed 
learning analysis should be considered. 



HoiA} do I uiabJUMk tkt cAJXeAWYi A? tae ion. 
cjomldmLng a mo^e doMAZtd ZmAyUng ayialbf^^f 
A lui deXoMzd IzaAyUng analy4^4.6? 

• The example below will assist you in understanding and establishing the criteria to 
be used for consideration of both MORE and LESS detailed learning analysis. 
Study it carefully before you establish your-own criteria. 



-I 



B 



\ \ \ \ \ \ \ I 



Q% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 

Percentage of intry^Type Students Failing Test Item 

WHERE: 

^ ^ LESS Detailed Learning Analysis . Any BASIC Task Element for which 0-20% 
of entry-type students the corresponding tiest Item will be considered for 
having LESS detailed learning analysis performed on It. ' 

B ^ NO Additional Learning Analysis. Any BASIC Task Element for which 21-79% 
of entry-type students M the corresponding test item will be considered to 
require no additional learning analysis to be performed. 

— _ ■ * 

C ^ MORE Detailed Learning Analysis. Any BASIC Task Element for which 80- 
^ 100% of entry-type students ftU the corresponding test item will be con- 
sidered for having MORE detailed leaniing analysis performed on it. 
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• In the example, on the previous page, 20% was estabhished as the criterion to use 
for considering performing a LESS detailed learning analysis. The criterion for 
considering performing a MORE detailed learning analysis was established at 80% 
in the example. In this example, any percentage value falling between 20% and 
80% the learning analysis as originally performed is considered correct, 

« It is important that you establish your own criteria for determining when you will 
consider performing a MORE detailed or LESS detailed learning analysis. There 
are no hard and fast rules for establishing these criteria. However, they should b^. 
established individually for each task. Such factors as task importance, conse- 
quence of inadequate training on life and equipment, possibility for self-training, 
training time availability, etc. should be considered. 

^ Tas^ i mportance. -The more important the task is to the overall job, the more 
important it ife to be certain that all necessary subordinate task elements are 
identified and represented in training, 

^ Consequences of inadequate training. It is especially important that all necessary 
subordinate task elements are identified and represented in training when 
inadequate training of the task might endanger life or equipment. 

— Possibility for self-training . If there is little possibility for a student to learn a 
necessary subordinate task element through self-training, then it is important 
that the necessary subordinate element be represented in training. 

Training time avai lability. Theoreticallyj the time available for training should 
not influence your decision in establishing the criteria for performing MORE or 
LESS detailed learning analysis. But on a practical basis, if training time is 
limited, some subordinate task elements may be sacrificed. If training time is 
available, be certain that all needed subordinate elements are represented in 
training* 

• We suggest the criterion for a MORE detailed learning analysis be no less than 
70% and no greater than 90%. 

• We also suggest the criterion for a LESS detailed learning analysis be no greater 
than 30% and no less than 10%. 
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• After considering all of the above, 
. for especially important tasks, 

^ for tasks where serious consequences may occur as a resuJt of inadequate training, 
^ for tasks which the student cannQt learn through self-training, and 
=^ when training time is not overly restricted 
ostablish the criteria as follows: 

MORE detailed learning analysis criterion: 70% ' 

LESS detailed learning analysis criterion: 10% 

Houo do I KzaoKd the. fl/UteJUa ^OK a mo^e/£ed4 
dztalttd tmAyiLng anaZys^^? 

• The criterion you will use for considering conducting a MORE detailed learning 
:4nalysis is recorded in Section III of the LAV Sheet. 

• The criterion you will use for considering conducting a LESS detailed learning 
analysis is recorded in Section IV of , the LAV Sheet . 



what doQM the, LAV She.U look Uk& a^toA tkz, cJvUeMMi 
loK a moKe,/iu^ dUcUZtd laoJmJjiQ analy^U havz 

EXAMPLE: 



ISD n 3 Describe Entfy Behavior 

LEARNING ANALYSIS VALIDATION SHEET 



(LAV Shstl) 




G.3S 



from biock ae 



Eiimini Fim/Niit 
lASlC Tuk eiirMnt 

LAV tl 



Sf tirminf it % Fitlmg 
TfSt Itlm iCg4 £) H 
Grlatif thirt Equ^ to 
{j» UnRE Oiuilf^ 
Cfitifia Rtc&cdid m 



to block 2S 



How doe4 LAI/ S^eet £oofe pe^Ue^ge ioAMm 

QXmtvi than oh. e.qual to the. "MORE deXoMzd" 
cjiaXqjujlI 

EXAMPLE: 







liETiDN HI 

/ CMi.i.*«e* MQfti BITaiLlQ ^"""^^^^ 

V 70. ) 


f^STlSN IV 




ii 


1 


(Cl 


ipi 

for AddMiun*! 












/ 








^ AZ/A"^ tiiitff MCft 

i 












AJ ^ 

X/fTfM^ii^ MAP 
























3^ 














4^ / I f J 






' 3^ 




A.i.l i LI 












BAti 


c 




30 






c 
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from block 28 




to block 31 



mat dau IM S^eet look ' tike. 
Lb fiQ.cj0n.d2.dl 

EXAMPLE- 



wkm "MORE doXauLL^d^' 



' "1 ^ 


^Mii and iCnewisd^l 








































































fi. A L t 
































SASfC 





























**vi-ft»Q P'niiil iQ* Mf< 



from block 29 



Ditfrmmt T\ Fiifjng ~ 
TfS! iiim (Cai Cf « 



far f.iifflplf, Iff fiffuft ■ 



6a^ng ^ lu4 than ok eqaae to tkz "LESS 



EXAIVIPLE: 




Aff/Ar^ ^'/Trv fi/^A 



8.^ 



2 



1 



30 



3G 



30 



JO 



Mo^f 
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from block 31 




33 - ■ 






ISKiiun V. Cut D. 







* Foi ei.implf^ itf tela* 



to block 35 



W/ia^ doe4 lAi/ S^eei -eoofe £tfee uokm "LESS dUoMe^d" 
'U A.gton,de.d? 

EXAMPLE: . ■ 
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from block 32 









c' P. 









from blpCk 33 



What dou LM SlmiX look tlk& wkm "NONE'' l6 
/Le.c.oKde.d? 

EXAMPLE: 



rf TAruLfj 



^■^ Use Cs/if^A^ 



X 



£0 



£0 

23 



do 

30 



30 I 



G»40 



EKLC 



2 IB 



from blocks 33 dnci 34 



to block 3 7 



\ / 



ff,.im block 3d 




to block 



iUlicLt LM Shzex look ttfee i^lim ^'AfORE ANALVS 

EXAMPLE: 



ISD 113 De?icribc> Enliy Bohnv^pr 

LEMniNG AflALYSIS VALIDaTiON SHEEi 
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h'/^f" iUffff 
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39 



*W 



Gas 
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from block 2U 




block 42 




ffom bluQU AQ 





Wluj Ae.po/Lt to .6u^DeAx)l6o/L tko, tcu>lu n.tqLUjujiQ mo tut 
analg^U and thosd ftmdy ion. ISV 11,4 acMvUleA? 

Your supervisor will decide liow to proceed with the iSD process. The dpcision to bo 
made is whether thf tasks which do noj, need additional analysis should bo sent on to 
the ncKL ISD hluuk. 11,4, Determine riiniuencu and Structure, while the other tasks receive 
additional analysis. Or, whether it woule be wiser to keep all the tasks topether and wait 
■ntU the additional analysis is eompleled before sonding any tasks on lo the next hlnek 
li. i. ' ' 



9 o * 



p^LiivioLLilLj conducttd It^'uiuig ancLtLf^ilif 

CcMiiact th(^ p(T;=^un who cuntluclud the original loarning anaiysis rpr any task in which 
thp anaiy^is is in question, (i.t .. thosp lankK for which ^^ADDrrfONAL ANALYHIS'^ is 
.t-LUiui iI Uii ihv Lop i)i tiu' Sht^L^L h l iiis Inuividuai may i)v ai)iu lu pruvuic valL]ai)lu 

inrnrination concerning \vhy and how a particular task was l)rnkon down intu subordinate 
tas]c c^kMiicnts or ^killn and kncAvlcdgcs. 

Therefore, it Is strongh/ recammendeci that you work as a team in the re^examination 
of learning analysis of tasks in question. 



Wka.t ikoutd loe. took qO/l ujktn 4e^excij?imuig tk(L o^LqMna,t 

The LAV Sheet for u specific task was labeled '^\DD1TI0NAL ANALYSIS" because 
tilt.' Icarnint4 aiiulysj,^^ \=aIiciaiUya iiiihraLud ihaL tJu' a^suiiipi iiJiis nKuii* in taa)4iiuu Itnii'iaii^ 
analysis enncerning the entry level skills ancl knowledges of potential trainees were 
incorreet. The validation may linve indieatecl onv or bulh gf the fullowiny: 

o The task was broken down too far for one or m.oru tusk LdementB and therefore 
"LKSH detailecr' learning analysis should he considered, (he,, entry^ype students 
already know the Bkills and knowledges retiuired for a task elemont identified as a 
JiASlC rask Llement.) 

^ Tiie task was not broken down far enough for one or more task elements and 
*'M()RK detailed" iearning analysis should be considered, (i,e., an extremely 
large pereentage of entry-type sUidents failed the test items associated with the 
fiASlC Tusk Element and there is a real question as to whether BASIC Task 
Klements have been idetitified at a sufficiently detailed leveL 

Therefore, the iearning analysis previously performed must be carefuily re examined 
for each task element in tjuestion and a decision inade as to wliether the learning analysis 
should be modified. 
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When re-examining the original leai-ning anaiysis always examine the modified learning 
pyramid in its entirety. For all BASIC Task Elements in quustion (**LESS/MORK 
detailed** recorded in Column D, LAV Sheet) the re^examination should include the 
following considerations: 

Q [f LI'^SS detail is indicated you must consider the question: 

— How does the task element presently identified as a BASIC Tahk Element relate 
to other BASIC Task Elements in the same branch of the pyramid? Look at 
the example below. For purposes of illustration assume two situations occurred 
as a result of the learning analysis validation. 

1 

Apriy RULES 

FOR UjF^tCTlQN 
rOR REAniNG 
. 



IPFNTIFV 
POINT 



iDENTiFY 
BLUE PaiNTER 



Situation 1 : Assume that the validation produced the following results: 

- Both 'identify Zero Reference Point'* and ''Identify Blue Pointer'* were 
incorrectly identified as BASIC Task Elements. Validation results indicated 
that entry-type students already know how to identify zero reference point 
and the blue ppinter. Therefore, "LESS detailed" has been recorded on the 
LAV Sheet for these task e ements. 

In this situation you should consider re-classifying the BASIC Task Element at a 
less detailed level **Identify Zero Reference Point" and "Identify Blue Pointer'* 
would be dropped as BASIC Task Elements (and not be included in training). 
**Apply Rules for Direction for Reading'^ would be classified as the new Basic 
Task Element. 

Situation 2: Assume the validation produced the follo%ving results: 

- "Identify Zero Reference Point" was correctly identified as a BASIC Task 
Elerront. 
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= "Identify Blue Fcinter" was incorrectly identified as a BASIC Task Element. 
Validation results Indicated that entry-type students already know how to 
identify the blue pointer. Therefore, ''LESS detailed'' had been recorded on 
the LAV Sheet for this task element. 

In this situaticm, if it were decided by you and the person who performed the 
original I earn i rig analysis that training is indeed not requirecl for '^Identify Bhu 
Pointur'' then it would be dropped as a BASIC Task Element, Hov/cver, \u ihis 
ease you would not classify the task element '* Apply Rules for Direction for 
Reading" as a substitute BASIC Task Element. Why? Remember, we earlier 
defined a BASIC Task Element as being most detailed subordinate elements of a 
task for which training is requirt?d. In tins situation '^Identify Zero Reference 
Point" is the most detailed subordinate element of this branch of the learning 
pyramid. Therefore, in this situation the result of our re-examination might be 
that we have one less BASIC Task Element. 

© If MORE detail is intlicated you must consider t he guestionj 

— Can the task element presently identified as a BASIC Task Element be mean- 
ingly broken down into further subordinate elements (or skills and knowledges)? 
For example, *Tdentify symbols** could be broken down into subordinate 
elements *Tduntify Colors" and *Tderitify Shapes \ On the other hand, if ''Iden= 
tify Blue Pointer'* was the BASIC Task Element and the validation analysis 
results indicated **MORE detailed** learning analysis should be considered, you 
might be hard pressed to meaningfully break this task element down further 
into more detailed subordinate task elements. It will be necess^y for you to 
use your own judgement (or the judgment of other subject matter experts) in 
deiermining if a task element can be broken down into more detailed sub- 
ordinate BASIC Task Elements, In reaching your jcision, ask yourself the 
following types of questions; 

= If the task element is broken down into more detailed subordinate task 
elements, will it be possible to prepare meaningful learning objectives for 
the new BASIC Task Elements? 



2 *J 3 

0^9 



. VV'iJ' 'H- poKsihlc to prepare' mt^aninRfui ^'st itcniK for thi; iiew BASIC Task 



- W'ii' p'f f I'y sunu-u.nt time, equipment, fndlitit-s, tite. for training of tho 

\\ the iir^-'':^i" to any of the abovo quustions is NO, tlu-n you shnuld not hruak tho 
''^k ilt^'^- "'^^ '^^t^iiltKi subordinate task -.lunu-nts. 



{^i^aJ- '^^(^^ ^lUngs nm.t be, aoiuideAp.d lA a modifiaciticn 
^ -i^ie- lining anaty^Ms ioxa •tcLik?''' 

m'L-/^"v t.£i'^'^,,'''''»t you make modifications to tho Iparning analysis, you must ronsidor 
%ftlit7n^OcIifjcationQn: . " ' 



tilt 

Obj 



-'PP"-^ipm '"^^ ^^^"^^ indicates that LESS detail is necessary for a BASIC 
• usk f'„"^*^"^> have d(?cidecl to replaco this basic element by moving 

*° a higher level task clement. As a consequence of this chanfic 
^ho of'^ ,^-' BASIC 1 ask Element will not be included in the training program ' 
'^'icl th^ . ^^fning objective for this task element will no longer be needed Be ' 
"^'^rt.nin, , these learning objectives are deleted so that they will not inad- 
Hrtcrit - - included in later training. 

if the ^fy^ Sheet indicates that MORE detail is necessary for a BASIC Task 
,*2bni«nj^! •^cl you have decided to break down the basic element into still 
^Wg.- and knowledges, you wil] need to prepare learning objectives for 
"^'1 nc^ Task Elements identified, 

P'lpck 'f * .'^ ^ask element in the learning pyramid that is scheduled to bo 
(.■■•'Tuclt'- ti-aining. Make certain that you have a learning objective for each 
f thoS'' *^ elements, and for only^hese task elements. 

cert^'" !^at any changes in tho leamrng analysis are also reflected in the 
Nckar ^output) resulting from ISD 11,1, Develop Objectives. 
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Test Items 



— For tho same reasons as explained above under learning objectives, test items will 
need to be deloted or added, 

— Crieek tmch task element m the iearning pyramid that is seheduled to be included 
in training and therefore tu be tested. Make t^ertuin that you have a test item 

I or each task elenientj and ioi lnt\se tasK elements, io complete this 

process you should coordinate with the individual responsible for ISD 11,2, 
Develop Tests, 



IF YOU MODIFY THE ORIGINAL LEARNING ANALYSIS FOR 
ANY TASK, IT WILL BE NECESSARY FOR YOU TO RETURN 
TO BLOCK 11 OF THIS JOB AID TO VALIDATE THE NEW 
LEARNING ANALYSIS 
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You should rpport to your supervisor to show him the following infornuition: 

' ii'l^n ) '''T'' ^ Identified: Level 1, Level 2 and 

HAbIt Level. 

- If nec-essary, a eorrected learning analysis that aecuratGlv renocts the entrv level 
i^^ilis and knowledge of trainees aiid the BASIC LevelTask Elements, 



9 n 1 



52 



•from hlocH 43 



to block 46 



acXivltl&A In ISP Pkcuz If 

You should coordinate wiih these indivlduais to iniorm them of any elianges made 
in the hnirning analyGis, These hidividuals should determine if the changes nffcct the out= 
put of their ISD block. If so, the necessaiy revisions should be made. Revisions may 
also be neeessarv in the Soldier's ManuaJ and the Commander's Manuah 



pQQ 
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frdm blocks 44 and 45 




iiitcLnnitiyf) m»y l^vi bt*h sbiiiiifd ^hti woyld 
ifQ tlipl ihil f »!Icw Ihii gni 



ipp'Dnii>ti piriani _ 
• Fcif fyiihi'i gyidinEi, iff bt^DM 



WhaX. X6 the. ^pontance, o£ pH.tpaJu.nQ c^rmmt& £ojj. p2joptk. 
mH.klng am otkzA htzp& the. J,m^ac^ioml system 
de.veZoptmyit pfwceMSI How do I maoHd .tkm? 

• In order for the Instructional Systems Development process to work effectively it 
is imperative that there be forward a nd backward communication between the 
people involved in the process. At some time or other you have probably com- 
plained^.about the input that has been provided to you. Sometimes, you may 
have had to do work that should have been performed in previous steps. 



IT IS IMPORTANT THAT YOU FEED THIS INFORrvlATION BACK 
TO THE APPROPRIATE PEOPLE SO THAT REVISIONS CAN BE 
MADE TO EFFECT IMPROVEMENT IN THE END PRODUCT, 



Iti^your research for this step of the Instructionai Systems Development process 
you may have discovered additional inform^ition that you think may be useful 
to people who will be working in steps \h^t follow this one. If so, it is equally 
important that you pass this infoxmation on to appropriate people. 

" ^" " / 



REMEMBER, COMMUNICATION WITHIN THE INSTRUCTION 
SYSTEMS DEVELOPMENT PROCESS IS CRtTICAL/FOR 
EFFECTIVE INSTRUCTIONAL DEVELOPMENT 



/ 

• A copy of the ISD COORDINATION SHEET can be found in the back of this 
manuah Maks sufficient copies to ena^U^ you to send one to every individual 
you wish to communicate with— plus copies for your records. 



« Complete the ISD COORDINATION SHEET in duplicate. Send one copy to the 
individual and attach ono copy to the package of LOD Sheets. 
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^--'-^ His? 




Liii ni \t\V% 



Qtiiijjnte Igr hjehhltrin'] 



1 Av 5r-«f 



trimtilFii S*£fi.'ti IP, 
LAV SHpi! 



hJinlilf^NELyiti Ah Lr^^l 

[Iftttgii V, Cfjll A ^ B. 
LAySlieJil 



liifMiily'RfCQFd An Livit 

I5*ttr,iri V TuU A ft D, 
LAV %t'm\ 



lrIlM!>ty'Rt£g(II Ail 
gA^iC filt Eifmcililiiid 

ISorhnn V CQ>i A & B. 
LAV ^>'^Rii 
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Afjei.ii.jiilf 


BASIC 








* SiOii-i 
















mpi«jtg 


I AV Shpsi 














tf?iu?ri F'<CuKi . Filling 


eatfeipuFPili 








LAV Eheftl 


^""'^ 
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BfliiRlllic/: 


i«ii<d 1 




Uiiiilig in 


pning 














iMmirir Fi! 


</Nci| 


BASIC TiU llemcni 


jS(£Mnn V, A ^ B. 


lAV 




28 ■■ 




U?lriF*iih« it 


F-iUog 




j[ Ci >f 






ihc MQRk Q 


ciiilfil 


Zi'.W.'.i KiClliikF? in 


Sit^fiun 111. LAV 
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Rtterd ^MQHE aiti.ltd" 
[Srctian V. Csi 
LAVShKlt 









r Go Id 
Black 



CSS 



ERIC 



ytrffmifsi ■! \ pifiiM^ 
The him (Cq! C) i| Ifit 
Thin ur |Qug< !u thi 

R«t!rtted S#£hnfi IV 
LAV Shfti 



<^ fnin (_" fguj! Hi t(5? 
DfM.ifii Ci!(fii* 















j£*Cfnjn V, Ciii D, 









I I.M.I V, Cil U 



Aj( EiASlC 



^ MQHf \ 



an rnp nf LAV Sfirfi 





"MORE ANAlrllS" 
tnv %tMft\l fium Dihcr 
LAV EhMli 
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JOB AID FOR 
DETERMINE SEQUEISICE AND STRUCTURE 



ISO IL4 



Manual 



This fs the 8th in a series of ISD Job Aids for use in instructional design and 
development. This volume is to be used as a supplement to the primary dQcument, 
**Job Aids: Descriptive Authoring Flowcharts ISO IL4 Determine Sequence and 
Structure." The flowchart document will direct you to specnfic guidancerexamp&^^ 
and referonces provided in this volume. If you do not have the primary flowchart 
document, request it from your supervisor. 



\ 

— — — ^ - — . — 

The wording in this manual should not be aonstrued to 
discriminate between the sexes. In order to avoid a \ 



repetltioui use of the tirminblosy, "he/she," the terms, y 
"he/' "him," and "his," as well as "men," are intended 
to fnclude ^th the maiauline and feminine gender. Any 
eKceptions to this usage will be so noted. 




ISD II A Determine Sequence and Structure 




i 

C IriUgduEtiun io Ihl U« 
\ Qf Jot Aidi - 



• Thii mirgduciisn pigvidH the yssf with 
Jab Aidi and Quidangi iar ihiir uu. 



lnl!QdyEi!i}n ig ihs Uif 
Qf JQh Aidi 



to block 3 
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from bjocki 1 and 7 




to bloek 6 



WhaJ: the. job old ^OK s^umay^^ng and qKoulpIyiq 

• GOAL 

The purpose of this job aid for sequencing md grouping learning objectives is 
to help assure that when instructional materials are developed, each learning 
objot dve is placed in the best relationship with other learning objectives to: 

produce the most learning in the shortest period of time 

— help the soldier make the transition from one skill or body of knowledge 
to another 

— assure that the supporting knowledge and skills are acquired before dependent 
subject matter is introduced. 

— In short, your task in this block is to identify the NATURAL ORDER OF 
LEARNING that is inherent in the objectives you wish to train. 

• OBJECTIVES 

1) Given a list of learning objectives, arrange them in the sequence in which 
instruction will be presented to the trainees. 

2) Given the sequenced learning objectives, arrange them into major groups to 
simplify further handling of broader content areas, i.e., modules, chapters, 
sections, etc. 



OVERVIEW OF MAJOR STEPS IN SEQUENCING AND 
GROUPING OBJECTIVES 



Step 1. Sequence the learning objectives for each task ih which the following rela- 
tionships between objectives are shown: 

a) dependent 

b) supportive 

c) independent 

Step 2. Group terminal learning, objectives by instructional setting 
Step 3. Determine appropriate sequence of terminal learning objiectives 
Step 4. Structure terminal learning objectives into groups 

Step B. Identify and group learning objectives which are identical between tasks or 
elements/skills and knowledges 

Step 6. Identify and group learning objectives which have common elements 
PRODUCTS 

Use of this job aid will result in the assignment of a poup letter (i.e.. A, C, D, etc.) 
and sequence number for every TLO and LO ii the course for which you are develop- 
ing instruction. 



WORKSHEETS USED 

The worksheets used in this job aid are the same as used in the job aid for ISD ILl 
Develop Objectives. They are: ^ 

—Learning Objectives Documentation Sheet (LOD Sheet) (See example on 
next page) 
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EXAfV!iPLE: 



ISD 11, 1 Develop Objtetivei 

LEARNING OBJECTIVES DOCUMENTATION SHEET 



-ffOM Sk.llM 



ilCTlDN II 

tfRMiN^L klARNiNq QiJgtTfVE 



SECTIQN III 



L*iir..nq Pbt^ELiif iSrVr.pi Cfin.l.f .jn* % Sf^ri.Uidi! 



'U 



I^K^^Ol I 



-+ 




Hr^^ pA4JC 



*i»^l*' 



^ H.6 
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^ Terminal Learning Objective LP Card (white) 
Learning Objective LP Card (yellow) 

below for completed examples. 



TERMINAL LEARNING OBJECTIVE 


LP CARD 

Group Letter A 


Initructional %^iXm ^AJ^'^ff^UT'/OAJ 


Sequence # _ J_ 


Learning Obiictive # )0d^ 




Action Statement; 











(white card) 



LEARNHSIG OBJECTIVE LP CARD 

Task # ^^^^SJ S-'MOf LO Sequence # ^ 

Element/inabling SSiK ^ A LO Group Letter 

Learnmg CatcgQry/Subcategory £_ TLO Sequence # 

Learning Objectjwe # f^S f TLO Group Letter _ A 

Action' Statements 



{yellow card)^ _ 

2ii 



• DESeRIPTlVE FLOWCHART 



~ T u ?°7f^hart on pages H.49 thru H-SO shows the major steps in the use of the 
Job Aid for Sequencing and Grouping ObjeGtives. The flowchart will be useful to 
you in getting a clear picture of the overall process used in this job aid A more 
completely described flowchart Is provided in Job Aids: Descriptive Authoring 
Flowcharts, pages H-3 thru H-ia. 
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rom brocks ^ and 5 



AviitiN* 



to biQdk 8 



• tiim.ni! iiiin.ng db|K!i*« (TLOii jhd 
Lf If fiing Oh|i£!i>"« I L Q\) ihnm hi Hi.ri^if 



QuidiMI iDi Obijininj 
till 9l tMrfijng 



to block g 



dfvllnpm^ DfijfctiyH in iSO It i 

• Wtin TLp! tnd LQl hi»l bsin Qblftnid, 
riiyfn iQ Dsfcriphvl Aulhaimg FlpKhin 
H 4, Of if rmtnt Bfqyfnci & Stfufturi, SlQEh S 



from block 6 



from hlork 7 



Job Aid \ 

t.lt Bf tlOl \^ 











□ gtim LOO SN«i Idi 
EkN TLQ ind 
AadCiglid W^iti h 
t|ilBw LP CjffH 




!0 





* Thi virion rnpgniibli fgf affvilDpm| ob\KhY 
ISO n i. wii knoft <l m Aidi wiri UHd tat 
r^ilnpmf Ihi liU fL Oi ind LQf 



) I! IN Job Aid Ml UHd >GF dfyglDpinf 
TLQi ind lOi, liifnmg QbiKfisn 
PDCyif»Plsl!oh Shnti ILQD S^it| fnd 
(nd fiifiin Lfttnit*! ^fifnia Ciftfa 

(LF CiF^I Mli bt rti'liHg it nilpul. 



Co/rbin! yillgn IP 

WifiPffpirid Wilh 
/^D^iilid Whiii 
LP ^Fd 



» For lich LPD Sfiitf ihiPf iligyld 5i nni 
L^ Cird ind i«irii ytilDw LP Cirdi 
Thi wftii! LF Cird rfprtunQ ihi lyO ind 
#ii yillDvf LP Cird npriiinii tht ' 
isQCiilid LQi 




to block 13 



from block 8 



0^lt>n Llarnmg Qb}Ktra« 
UKumsnUTidn ihiiEi 

kfld YiHsw Ltirning 


]* 




^Hl Finl/NisT TLQ 
W)1h m AsKiatld LDi 






L Q D ShHi 


ig 






n 




□t LGS ih^i 







■ LOO S^Ht! Ihd iNfiMI ind ,>t\\Qm LP Cicdi «■ i«i<liblf idf dupMfiitQn m ih? 
pQ£k|I if Ih| bick oi Jab Aid tgr D^ttQ^inf Ob)f(tiwn Minuil 



For ^idjnEi !i! BIgck 12, pi|f E 0»€ripii*i Authgnng FiaMhirn 
ISO i| I Qtviisp Qbi|El!«il 



Fiiiwchim, iSD II 1 DrviiQP Osini'VEi 



to bloek 18 



ffOm block 17 



yitEf Slink Whiff 
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InilrLiEliDnil Sfltmg 


Ltlrnmg 







eoidjfiii ,! iy„liblf in iiack Biqs E B. Pfyf,pf,»g Aufhafrng FiD«h#m. 
lay M 1 gryiigp QbjfECiifi 



to block 20 



2lG 



H.)2 



frem block 19 



^ifft ^(s! YeliQw 
Lurning P^rimid 
Cjfd3 {LP tiisi) 




V __ 






Ena&iinsi Stilli and 














YtllDw LP [lit.i 
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CijfTibtriB IfilQ 3 St /tk 

LP ^rdi Aiiocijiril 
With inn 'J^—i 



The i;'tLtniJ!rsi-i iHi^iiUii! rfis ¥L«ilyiif IP Cji^i li, ■ 

= Task s _ - , Lrgtfitnq Qbi^nisE 

- felFrrenr/EriitjIiny riSK - . Agfrfjn SlaiemEnt 

-= Lejfning Cjijgti?Y/SyLcJ'i'ij3ry 

The ibe^8 ififefPUhfiii ii (fcm she LQO E^f?; 

Gfcup Leiigf jofj SggygncB = (| iefr blink ~3\ ihu pQinf. 



to block 23 



from block 23 




to block 25 



How do I doXoMmlnt tlie. ^elA^LoyulilpA beAueen 



© Keep in mind that there arc tio hard and fast rulos for sequencing objectives. How- 
ever, there aix* rules of thumb wiiieh will help you devise a reasonable sequence, 

@ In order to secjuence two learning objectives, you must first determine the relation^ 
ship between Uiem, Two lea^rilni^ objectives may have; 

1) a depencient relationshii), in that mastery of one requires prior mastery of 
the other. 

2) an independent relationship, in that they are totally unrelated and independent 
of eac'h other; or 

3) a sup[)ortive relationship, in that some transfer of learning takes place from 
one learning objective to the other. 

® The tai)le on ^he next page eontrasts the three types of dopendent, independent 
and sup|)ortive relationshiiis. T\\u table also provides examples of each of these 
relationships and shows how the relationship affects seciuencing. 
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I ypes of Relationships Between Learning Objectives 



DEPENDENT 


INDEPENDENT 


SUPPORTIVE 


Skills arid knowledgys in une 
learning objective are clasely 
ralated to those in the other 
learning objective. 


Skills and knowledgns in one 
learning objective are unrelated 
to those in the other learning 
objective. 


Skills and knowledges in one 
learning objertivo have some rela^ 
tionship to those in the other 
learning objective. 


To master one of the learninf] 
objectives, it is first necissary 
to niaster \ht other. 


Mastering onn of thu learning 
objectives does not simplify 
mastering the otfier. 


The learning involved in mastery 
of one learning objective transfers 
to the other, making learning in^ 
volved in the mastery uf the other 
easier. 


EXAMPLES: 

In niath, in order to learn niulti^ 
plication one must first learn 
addition. 

One cannot send messages in 
Morse Code without first having 
mastered the codes for each of 
the tetters and nunibers. The 
"sending" skills are totatly 
dependent on the prior learninf]. 


EXAMPLES; 

For a clerk typist,- "type letters 
from drafts" is independent of 
'^maintain files/' 
For a wheeled vehicle mecfianic, 
^'adjust carburetor" is independent 
nf ''torque engine head studs/' 
In both examples, knowmg hovv' 
to do one would not help much 
with the other. 


EXAIViPLES: 

'^Assemble weapon" has a sup^ 
portive relationship to "disas^ 
semble weapon." 
"Drive a 1/4 ton truck" Ms a 
supportive relatmnship to "drive 
a 2^1/2 ton vehicle." In both 
examples, learning to do one 
would help considerably in 
learning to do the other. 


The learnmo objectives must be 
arranged in the scquenco indi^ 
cated by the above literarchy. 


In general, the learning objectives 
can be arrango'd m any sequefice 
without loss of learning. 


The learriing objectives should be 
placed close together in the se- 
quence to permit optimum transfer 
of learning from on& learning objec' 
tivB to the other. 
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Some effects of seqiiencing are: 

^' Se quencing effects are lon g-range. The advantages or disadvantages of using 
any sequencmg ijcheme will not likely show up immediately. Therefore end= 
of=course tests should be used for evaluating effectiveness of sequencinR'tech= 
niques. W.thm-course trsts of small portions of the course are not likcSy to 
reveal the true effects of sequence, 

2- Sequence is hnportant to lowaptitnH. .f„H»... Students who have a high 
aptitude for the subject matter will learn it in spite of sequencing. The lower 
aptitude of the learner for the content, the more important it becomes that' 
some type of sequence and structure is provided. 

3- Se^ce is important with unfamiliar mat.H.l. students who are familiar 
with matermls will learn regardless of order of presentationn But as material 
W^S increasingly unfamiliar to the student, the importance of sequence 

4. Sequence is importaniwith non^redundant materials. Some instructional 
materials are especially redundant, stating important points over and over 
^ain^ Sequencing is not especially important with these materials, because 
the student can pick up the .second time anything he has missed the first 
time. But If materials are non^redundant and state their points only once 
It IS important that the materials be sequenced according to some rationale 



from block 24 



Sf!e«i arid Asacii'sd 



to block 27 



o Sequencing learning objectives that support a TLO. 

1) Review each Learning Objective LP Card on which you have an action state- 
ment to determine if certain skills and knowledges are prerequisites for others. 
Ask the question, ''What other skills or knowledges must the student have in 

.order to accomplish this task?'' The answer to this question will help you 
identify the proper sequence for prerequisite objectives. The simpler pre- 
requisite objectives should be sequenced before the higher-level (complex) 
objectives of which they are a part. For example, before a person can multi- 
ply, he must be able to add. Learning how to add is a prerequisite for 
multiplying, 

2) Arrange and rearrange the Learning Objective LP cards until you are sure the 
enabling skills and knowledges (prerequisite objectives) are placed before the 
higher level more complex objectives. In other words, construct a shorthand 
pyramid, 

= For example, a terminal leai^ning objective with its learning objectives might 
look like this when the cards have been arranged, (See next page) 
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Shorthand Pyramid Displaying Learning Analysis 




1 ' 


1 


1 


MATCH SYMBOLS 






TO ACTUAL 




MATCH SVMBkjLS 






TO LEGdND 



lOINTIFY 
^YMflULS 



fitAtJ CQMPASS 
VAl UtS FfiQM 
SCALE 



lUfcNTlf Y 



i m T I T V 
SHAPES 



1 




FiEAD VALUES 




APPLY nULtS 


WITH 




FOR DlNfCTidN 


irpolation 




FOR READi.'iG 









iDENTlFY 
fiRADUATlON 
MARKS 











1 




lUENTiFY 








ZERO 




lUENTlEY 




REFERENCE 




BLUE PGiMTER 











Note that before you can master the TLO of ^^get from Point A to Point B/^ 
you must be able to do two learning objectives: ^^orient map and compass/' 
and **hike with a pack.*^ Some of the learning objectives under ^^orient map 



have dependent relationships, Thesi? hierarchiuaily^ordt^red objectives are, 
therefore, emy to sequence. One sequence is: 

1. Identify symbols 

2. a. Match symbols to actual terrain 
b. Match symbols to legend 

3. a. Use legend 

b. Use grid system 

4. Interpret map 
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block 23 



Hou) do I 4eqaenee oDjea^tcueA M^tli ^uppo^tLve. ^oMZwiuhlp^? 

1) Continue to study the Learning Objective LP cards which make up the shorthand 
pyramid for this task. 

2) Arrange objectives with supportive relationships us close together in the sequence 
as practical so that optimum transfer of learning can take place. 

3) Arrange objectives close together if the conditions under which the learning 
objectives are c^uried out are identical or similar, and if the conditions are diffi^ 
cult or expensive to produce at random times. For example, if several leai^ning 
objectives have conditions such as **at night/' ^'on muddy terrain,'' or 'Hvhen 
flying at an altitude of 20,000 feet,'* you will probably wish to place the **at 
night'* learning objectives together, the ^*on muddy terrain" learning objectives 
together, etc. 

4) Arrange objectives close together if a particular piece of equipment must be 
available in order to accomplish a group of learning objectives, and if you are 
not likely to have continuous access to that equipment, you will probably wish 
to group the learning objectives that use that particular equipment. In addition, 
you will want to keep the order of the group of learning objectives within the 
total progrum as flexible as possible. For example, if the learning objective 

is **perform maintenance on helicopter," you will have to wait until the heli- 
copter is available for maintenance before you can accomplish the objective. 



from block 27 

i 



jrf,=,iiffi£:j U?}W,lh , • T^r^s^ ntiiit ur^,n\,^ri mi^ t>3,t in ,h4ff,r- itr^Ue^ iffy .ih 



to block 29 



Hou) do I 4eQuenae objecucueA (^^t independent ^LcZa.tlan^hA.rU? 

1) Learning objectives with independent relationships may be arranged in any 
sequence. Any of the guidelines listed for sequencing learning with a supportive 
relationship may also be used for sequencing objectives with independent rela^ 
tionships. However, with the latter, you need not be concerned about locating 
the learning objectives close together in the sequence unless condition or equip- 
nient constraints indicate otherwise. 

2) Some of the learning objectives present more of a sequencing problem, however. 
In an example below, which should be placed first, **read compass values from 
scale'' or '*align points with scale?'' These can be placed in either order, so 
long as they are both placed before *'read compass,*- and as long as ''read com- 
pass from scale" comes after the five learning objectives under it. 



fllAD COMPASS 



PEftQ CQMPASi 






VALUES f HQM 




ALIGN POiNTS 


BCALE 




WITH SCALE 




iDlNTiFy 

GRADUATION 



IDENTIFY 






lIRO 






REFIRENCE 




BLUt POINTER 


■ POINT 
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However, if you place *'align points with scale" wijliin learning objective 1 through 6, 
yoii would interfere with the dependent sequence of those learning objectives. There- 
fore, unless you had a good reason for doing otherwise, you would place "*align 
points'' either after "read compass values from scale" or before the group of learning 
objectives that have a dependent relationship to "read compass values from scale," 




MtAU COMPASS 



OR 



HtAn COMPASS 
VALUES fftCm 
SCALE 



^LiGN POINTS 
WITH SCALE 



MEAn VALUES 
WITH 
INTERPOLATinN 



iDENTlf ¥ 
riPADLjATiQN 
MARKS 



APPLY RULES 
FOR QiRfCTIQN 
FOR RlAQiNH 



iDENriFV 

REFERENCE 
POINT 



IDENTIFY 
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from biock 28 



What pLLn.po4a. dooM tiio. ^^qupMC& rLLunbeA 4eAue? 

® In blocks 26, 27 and 28 you sequenred the LOs for this TLO by the types of 
relationships between the LOs. You determined that some LOs must be trained 
before others because of their dependent relationships; others should be presented 
together because of their supportive relationships; and for some the order of 
presentation is not important. The sequence number you assign in this block is 
a documentation of this sequencing. It represents a first judgment of the order in 
which the LOs should be addressed in training. In later blocks (blocks 37 and 40) 
you may find that this order noods to be modified. For example , you may find 
that a LO represented in this TLO may be represented in another TLO. If so^ 
you will probably not wish to give training for the LO for every TLO in which it 
is represented. The judgment as to where it is best trained will be made later. 
In this block you will make only the first judgment. 



HoiA) do I oisMgn tk^ LO 4eQaenee nmbiiA and w^eAe do 
I K^QJ^Kd JM 

® The LO Sequence number is recorded in the upper right comer of the Learning 
Objective LP Card. 

& Start with the LO that you have determined should be trained first when this 
TLO is being presented to the student. Record a LO Sequence number of ''1" 
to this LO on the corresponding Learning Objective LP Card, Record a LO 
Sequence number of *'2'* to the LO that should be trained second. Continue this 
procedure until sequence number has been recorded for all LOs for this TLO. 
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WliaX dou tkt LzoAyUng ObjecMve. LP CoAd look 
Hk^ aiteji tkt LO S^qumaz ntuvbeA kcu been 



LEARNING OBJECTIVE LP CA 

Task # a aa loA f 

ElBment/Enabllng S&K # ^ 

Learning Category/Subcitegory ^^TMj&jAMXAm^ 
Learning Qbiective # I^a^ 



4^ 



Action Statement: 



LO Sequence # 
LO Group Lett¥r 



TLO Sequence 



TLO Group Letter 
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from block 29 



LOP Shsi'j! B*fn 







Grsyp TLOi by 





















21 



lu bigck 33 



H-25 



from block 3^^ 



How do 1 ^tqamct TlO^l 

e The same guidance for sequendng LOs applies to the sequencing of TLOs. 

- Arrange tlie Torminal Learning Objectivo LP cards into a nem- shorthand 
pyramid. It is impractical to rearrange accompanying LOs, however keon 
in mind that when yuu place a particular terminal learning objective' in a 
certain position in the sequence, you will later locate the learning objective, 
that support the terminal learning objective with it. This is because of the ^ 
dependent relationship of the learning objective to the terminal learning objec- 
tive and oecause of the transfer of learning that is more likely to occur when 
closely related leaming objectives are kept together. ^ 

- For example: One terminal leaming objective might be to operate a certain 
piece of equipment, while another terminal learning objective might be to 
instruct others in the proper operation of the equipment. Most Hkely a 
dGpendent relationship exists between these two torminal learning objectives^ 
Uierefore you would place "operate equipment" before "instruct others " ' ' 
ihe guidelines for sequencing supportivu and independent TLOs are likewise 
the same as given for LOs. , 
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HoM do I aM&lQn and Ke.c.on.d tmUnat IzaAyUng objzcMve, 
4zque.nae. numbeJi&? 

• Assign a TLO Sequence number of "1" to the TLO which is to be trained first; 
a "2" to the TLO to be trained second; etc. 

• Record the TLO Sequence number in the upper right. corner of the following forms: 

— Learning Objective Dof umentatlon (LOD) Sheet 

— Terminal Learning Objective LP Card 

— An Learning Objective LP Cards associated with each TLO 

What do u ikz teAminaZ ImAyUng obj^cjUvt L? CoAd look 
LLko. a^teJt the. TLO sequence numbeM. ka>& be.e.n 
Ke.con.dtd on tt? 

EXAMPLE: 



TERMINAL LEARNING OBJECTIVE 


LP CARD 

Group Letter 


Instructipnal Settinq T'U'r/aAj 
Learning Objective # /^A ^ 








Action Statement: ' ■ 

/}jJ<e ^^ro^ ^0,^r S ^^^^,/^ 

\ 
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(ilhat dOQj, the, Le^oAyiing Obje.cJU.vz VocmzntaMjon Sk^oJ: 
look Hke. aitm the, TLO 4>e.qumc.e, nmbeA fm been 
n.e.Q.oJtdtd on ^tf 



iSD IM Develop Objective's 

LEARNING OBJECTIVES DOCUMENTATION SHEET 





_ . . 0^'^ 


lECTlUN II \ 

f«k ifi N.j 33^- ^7S"- /^^^ l^s^f^u+fs>\ 

TfHMiNAL llfkHWfiC, OliJltltiyt 

^^t,M,> si.F.ni'Mf ^h^^Jj^hmSi-^i^LAfK^'. 'f^ , ' . 

i^'i'-M^^^^^^^ _ 




______ „___^._._..._..,L_„ 
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A.3L 



1 




Mi 
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a Ltanmjig 0bje.cXlv2. LP CoAd took LLkz a^teA 
tkz TLO 4>e.qamc.e, numbeA hoM bmn- n.e,c.o^de.d''on Itl 



LEARNING OBJECTIVE LP CARD 



Task # 3^fO- gT'y- yrf^f 

ilemBnt/EniblIng S&K # 



Lsarning CatBgory/Subcitaflory ^'^^^^ j^ i*? ^**^ ? 
Learning Objoctive # / ^ " A 




Action StatemBnt: 
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to fjinck 36 



Hou) do I ^jC/lucXua^ ie/uriLncLt ImAnlng 0bje.cX4.vu 
^nto g/ioup6? 

• While sequencing TLOs, you undoubtedly realized that you were dealing with quite 
a few items; so many in fact, that you might have had difficulty in getting a clear 
picture of the relationship between all of them. You can partially overcome this 
difficulty by dividing the TLOs into large groups that will provide organized 
manageable blocks of content with which you can work. How many TLOs you 
pToup into a block is an arbitrary matter. At this point, you are simply identi- 
fying TLOs that can be grouped because of the close relationship between the 
learning objectives. Involved. 

• Advantages of pouping (structuring) TLOs 

1) Grouping content areas early will help you get a clearer picture of the scope 
and nature of your developing program, 

2) Grouped TLOs can be worked on independently. If one person is responsible 
for development of the total system, he cr.n work on later groups if all the 
material is not available for earlier groups. 

3) When more than one person is assigned to develop course materials, different 
people can be assigned responsibility for different groups. Each person then 
can work relatively independently on a gi'oup of Jeaming objectives, con- 
ferring with others as needed, 

• Guidelines to help in dividing TLOs into groups 

1) For a particular poup, select learning objectives that bear a close relationship 
to each other. Combined, they should make a self^ontained poup. 

2) Combine learning objectives so that the poup has a natural begim rid 
ending point, 

3) Be sure all leaming objectives are included somewhere. In general, learning 
objectives within your poup: will remain in exactly the same order as your 
original sequence. However, since dividing leaming objectives into groups 
should help clarify your total program, do not hesitate to re^sequence objec- 
tives where necessary, 

4) Do not assume that your group of learning objectives is unalterable. Subse- 
quent decisions may require you to re-evaluate what should constitute a poup. 
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• Procedure: Sort the Terminal Learning Objectives LP Cards into groups by using 
the guidelines on the previous page. See example below. 

EXAMPLE: TLOs which have been sequenced and structured into groups. 



Input to You 



For 0 given 
job, 

learning 

objiCtjvgs 

that 

identify 

all 

behaviors 
that 

must be 

acquired 

by thB 

trainee 

during 

instruction 



Step A 
Deterrnine the Optimum 
Teaching Sequence of TLOs 



TLO 1 

TBach First 



TLO 2 
Teach Second 



TLO 3 
Teach Third 



TLO 4 
Teach Fourth 



TLO 5 
Teach Fifth 



TLO 6 
Teach Sixth 



TLO 7 

Teach Seventh 



} 



Step B 
Group TLOs 
hito Qlocks 



Group A 
Block of TLOs 
taught first 



Group B 
Block of TLOs 
taught second 



Group C 
Block of TLOs 
taught third 



Group D 
Block of TLOs 
taught fourth 



\ 














Teach Cffst - 



Group H 
Block of TLOi 
taught last 
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Hou) do I 044 g/LOup IMeJU to immLywLt leM/LyUnq 
obje.cM.vQJi? 

• Now that you have determined which TLOs can be sorted into related groups you 
are to assign an alphabetical letter to each of these groups. The group of TLOs 
that are to be trained first should be assigned a poup letter "A". Those trained 
second, "B", etc. Continue this procedure until all groups have been assigned a 
group letter. The example on the preceding page illustrates the assignment of 
poup letters. 



e do I KtcjoKd the. tvmlnat ZmAyUng objzcLtivz 

• The group letter is recorded in three places: 



1) 

2) 
3) 



In the upper right corner of all Terminal Learning Objective LP Cards included 
in the group 

In the upper right comer of all Learning Objective Documentation (LOD) 
Sheets included in the group of TLOs 

All Learning Objective LP Cards associated with each TLO 
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Wkat dou a jQjurU.naZ LzoAnlng Obje,ctlve. LP CaJid took 
tike. a^teA the. TLO g/LOUp tttteA hoM be,m 
H.e.c.oH.d^d on JXI 



EXAMPLE: 



TERMINAL LEARNING OBJECTIVE LP C^RD 

Task # 35^ " S7i\-' JaaB 



Instructional Setting XjULAjlL^ l^rf ^ aJ 
LBarnlng Ob|ective # iOQ ? 



^roup Letter 



Sequence # 



Action Statement; 



/ji/c'e ^\r©m j^oi^r ^ ^ ^eiAJT" S 
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What dozM a. Lmmlng ObjtcZLv^ VodmmtcU^yi [LOV] 
Ske.U look Ukt aiteJi the. TLO gnoixp lUteM. ha^ be.m 
Kz.cah.dQ.d on JX7 



EXAMPLE: 



ISD IM Develop Objectivoi 

LEilRIIINa OeiECTIVES DOCUMENTATION SHEET 



TErMiNAI. LfARNlND QSjfCrjyi 



J QDiSttii* JAci.drv Ci3r..j.i.oni A 



A 



A,Lk I 



. AMU 



if £ e^^s 



A.LLUJ 
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What dou a LtaAyUng Obj^cMvt LP CoAd look tike. a^teA 
the, TLO g/LOup ZeMeA ha^ be.m AgcoAdtd on iti 

EXAMPLE: 



LEARNING OBJECTIVE LP CARD 




LO SequBnci # 


ilement/Enabiinq SgiK # 


LO Group Letter 


Learninp Cateqofv/SubcatBqorv ^ . ^ * *^ ^ 


TLO Sequence # _ /I 


Learning Obiectjve f /GO ? ^ 


TLO Group Letter 


Action Statemint: 
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H-3S 

o 

ERIC 



from biock 36 



i^ntify/GiQup 
Idtn Ileal LOf 



• Sarnt iHki miy cpntiin LQi Igf fiiininti oi iki|i| ind knmiidffH shil iii 
<hi urfii « toi yfhir IiiM, In thii ilip Ifitu LQi aft idlnlifisd'ind gi aupid 

• Fei luiihif guidinei, t#fl bftnv. 



to block 38 



How do I Idmtliy QKowp Idgn^cM Imming obj%cMvuf 

• Some tasks may contain learning objectives for elements or skills and knowledges 
that are the same as for other tasks. It is important that these identical LOs be 
identified at this point because in many cases you will want to schedule the train- 
ing for these LOs so that they are only taught one time. Generally, the training 
for these LOs should occur when the task contaiiiing one of tiiese identical LOs 
is first taught. For example, look at the partial learning analysis below: 





REPAIR PRINTED 
CIRCUIT BOARD 






















1 1 


TROUBLi SHOOT 
PRINTID CIRCUIT 
BOARD 




RilVIOVi 
DEFiCTIVi 
CAPACITOR 




REMOVE 
TRANSFORIVIER 


f * * 



DESOLDER 



DESOLDER 



• Consider the learning objective "desolder,'* It occurs under both "remove defective 
capacitor" and "remove transformer.': You will probably want to schedule the 
teaching of desoldering only one time. If previously you had determinRd that the 
task element, "remove defective capacitor" was to be trained before **remove 
transformer" then desolder would be scheduled for training only as a part of the 
training for **remove defective capacitor," It would be assumed that desoldering 
training would not need to be repeated when providing training for "removing 
the transformer," 



27 Q 
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• Follow this procedure for identifyjng and pouping identical LOs: 

1) Sort into stacks airLeaming Objective LP Cards that contain identical 
action statements. 

2) Check these Learning Objective LP Cards against the LOD Sheets to be 
certain that the conditions and standards for each is ^so identical or very 
similar. 

3) Alphabetize each stack by TLO Group Letter. 
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from biock 37 



Any 



CfDup Littif on Vnigw 
Clf^ fer Ail idiniieri 
LOl 



• Far (urihf! njid4ne@, fw be'i)w. 



to bloek 40 



What and^iA}ki/LZ-do I mao/id th^ Immlng obje^ctlvt 

• The to Group Letter is the same as the TLO Group Letter of the top card of the 
stack of alphabfjtized Learning Objective LP Cards. 

• The LO Group Letter is recorded in the upper right corner of all Learning Objec- 
tive LP Cards in the stack, - 

• It will be necessary for you to change the LO Sequence namber on all of the 
Learning Objective LP Cards in the stack except for the top card. 

^ Draw a line through the Sequence number originally recorded 

Record on all cards In the stack the LO Sequence number shown on top card 
in the stack ' 

SUMMARY: All Learning Objectivs LP Cards In the stack 
of identical LOi will have the lame LO Group 
\ Number and LO Sequence Number, 



dou a, LmA.vUng Objtctive, LP Cmd look .Like. a^^teA 
the, LO gn.oiip IttteA haj> b'im KtcjoH.dtd and tke. LO 
4equenae # hm be.m c}iang&.d? 

EXAMPLE.- 



Task # 



LEARNING OBJECTIVE LP CARD. 



ileniBnt/inabling S&K # ^ 

Learning CaiegDrv/SufacategQry ^^y^if.^ ^ ^ y ^ 
Learning Objective # / O 2 Z ^ # / 




TLO Sequence # 7 
TLO Group Latter 



Action Statiment: 
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to block 41 



i Cgmfngn liclQr iHfnmg gb\K\nm iri lO| thir hfvf i^ned Khen wfiifi 
•"3 iimilif gbff^Q et ihi Ktign »n ihi liimmj gbjiEiivi lUlimfnr 



Ho(^ do T Idzn^^y and g/ioup aomnon iaa;toK leMAyUng 

p The example below describes what common factor learning objectives are 



IPfNTIFY 
CAPACITORS 



IDENTIFY 
CODES 



iDENTIFV 
TRANSISTORS 



IDENTIFV 
COLORS 



IDENTIFY 
SHAPES 



IDENTIFY 
RESISTORS 



IDENTIFY 
SHAPES 



IDENTIFY 
CODES 



IDENTIFY 
COLORS 



IDENTIFY 
COLOR BAND 
SEQUENCE 



In the above example note that ^Mdentify capacitors,*^ ^Mdentify transistors'' and 
^'identify resistors*' each have the common factor of identifir as the common 
factor between them. One logical way to handle, these common factor learning 
objectives is to consider grouping all "identify** learning objectives and place them 
near the beginning of the course. 

While common factor learning objectives generally should be listed early in the ■ 
sequence because they repfesrnt information or skills basic to many learning 
objectives, the delay between introducinf such objectives and the actual applica^ 
tion of the objectives should be minimized. This is so that material learned at 
the beginning of training will not be forgotten by the time it is practiced as a 
part of other learning objectives. ^ . ^ 
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o' 'i au^procetlure to use Tor identifying and grouping commoji factor learning 
objoctivos is as foIlowH: 

1) Sort into stacks all Learning Ol)jectivo LP Cards which have common factor 
elements 

2) Check these Learning Objective LP Cards against the LOD Sheets to be 
certain that after examining the conditions and standards for these LOs 
they should still be grouped together, 

3) Alphabetize each stack by TLO G roup Letter, 
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'•w block 40 




and LckoAt da I Kmon.d Hit IzaJuUng obj active. 
g/Loap le^tteA ioK LOU that have, comm'on iactjO/L&f 

I hv procedure to mo for determining what to record and where to record it for common 
factor LOs is the same as that for identical LOs, That is: 

© The LO Group Letter is the same as the TLO Group Letter of the top card of 
the slack cf alphabutized Learning 01.)jective LP C^irds. 

The LO Group Letter, is recorded in the upper right corner of aU Learning 
iective LP Carcis in the stack. 



^ It will he necessary for you to change the LO Sequence number on all of the 
Learning Objective LP Cards in the stack except for the top card, 

— Draw a line through the Sequence number originally recorded 

-~ Record on all cards in the stack the L() Sequence number shown on the top 
CiU-d in the stack 

SUMMARY: All Learning Objective LP Cards in the 
stack of common factor LOs will have 
the same LO Group number and LO 
Sequence number, ; 



I 
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doQJi a. ItaAnJjiQ Object^vi. LP Cand look tikd 
a^tm tilt LO g/ioup leMoJi hcu bdm ^eco^ded and 
the. LO ^tqumcQ. # kcu hem diangz.dJ 

EXAMPLE: 



LEARNING OBJECTIVE LP CARD 

Element/Enobiing S&K ^ _ P ^ 

Learning Category/Subcatopry^^^^^^^^"^^ 
Liarning Objective ^ l% iZ ^ /m Jm ^ 




LO Group Letter C 
TLO Sequence 
TLO Group Letter 



Actton Stdfemefii: 



J 
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from biocks 45 □nd 4B 

4/ 



^ifiO' I rjf,;i.p J,- 

Ji'ii S*- its; n 



J 



to block 4B 



Wto gmap l2Xt2A and sequence ^ do I .teaoAti a>irf ai/igAe 
cto I /Lecc'^d ^ on tkt LOV ^/le^tf 

^ TliP Group and Sc.qiin!u.e numbw are tho^,. n^.-ordtui m th.. iiiniiks inr It) 

Group Letter and LO Seqiieiicu numbnr. However, in somt? cases there mav not 
have been a LO Group Letter and/or a LO Heqiience number assiyned In these 
eases use the entry made for TLO Group Letter und/or TLO Seciuen<-e number 



lU^cord tho appropriate^ Grouj) Letter and SequeiKro number in Sertion 111 
Column K of tho LOD Shuot, 

ChcM'k to l)e rertuin that thrru is n nroup Letter/Sequence Number enirv for 
each piemont/enabiinp Hkills and knuwiedgos nhown on the LOD Sheet tor 
wiueh a learnmg oiijoctive was requirc^d (Column H). 



273 



Wkcit doQA -die LOV SliP,(Lt look tike, a^toA tiit g'wup toXtvil 
6Q,qmnct munbiin. liava bnoi A.Q.c.o/ide.df 



EXAiVIPLE: 
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mmm objectives DGciiMEMrATiori sheet 
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groups un^m^ ^^«4e/ 



J 

Hf^*- feurt^ pa^< 
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fr.jrn block A'f 



'■■•■i, iijs': 5,ti!i .j5iij!!i!-J ihji *fiLi!iJ 

"V' :^ fn..>'il fit- ^iU'ti!' l„ JiCiiiiii; 

■•' i-J^'T I:<il'...4!i>ru! 'svlff 'i Ui'Wtfl.ig 



Ullage lb tkt inrpo/utanat 0^ p/itpajuLng aomnmht& ^04 people 
making In otkeA 6ttp^s 0^ .t/ie lyutmatlo not ^y6 tarn 
dtv2.lopnmiX p^oaU6? Ho^) do I mojoKd tk^jn? 

o In order for the InHtructlonal Systems Diivolopnient proceHS to work effectively 
it is imperative that there be forward and backward comnmnication between the 
peoi)lG involved in the proeess, At some time or other you have probably com= 
phiined al)out the input that has been provided to you. Sometimes^ you may ive 
lu?d to do work that should have been performed in previous steps. 



IT IS IMPORTANT THAT YOU FEED THIS INFORMATION BACK 
TO THE APPROPRIATE PEOPLE SO THAT REVISIONS CAN BE 
MADE TO EFFECT IMPROVEMENT IN THE END PRODUCT, 



In your research for this step of the Instructional Systems Development process 
you may have discovered additional information that you think may be useful 
to people who will be working in steps that follow this one. If so, it is equally 
important that you pass this information on to appropriate people. 



REMEMBER, COMMUNICATION WITHIN THE INSTRUCTIONAL 
SYSTEMS DEVELOPMENT PROCESS IS CRITICAL FOR EFFEC- 
TS E INSTRUCTIONAL DEVELOPMENT FOR SUCCESSFUL 
MISSION ACCOMPLISHMENT. 
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H.47 



A copy of ih, ISD COORDINATinN SlIEKT can 1,g found in the- back at this 
MHinual Mak.. sufUriont copies to onablo you to send onr lo nverv inciividual 
you wirih to communicatG with-plus coiiics for your records. 

Complete tiu. ISD COORDINATION SHEET in duplieate. Send one copy to 
the nu hvulual and atlach one copy to the . Truction Settings Selection Package 
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